:W&Bá¾ÿÝíÍM dnrp7hvvª; 9 /0.29.0+7872fd9d9f86ca5c50617e19cb168122b7f959480.70.0\Nô'ù‚" fbeii04wqobo dnrp7hvvŠÕ dnrp7hvvjuju11-uc-san-diegoSPAtop"˜ _wandb‚{}  batch_size‚512  dataset_limit‚0.2  dropout‚0.25031538449633606 epochs‚10  hidden_dim‚128 & learning_rate‚0.001196227745186227  num_attention_heads‚4  num_branch_encoder_layers‚5  num_embedding_layers‚6  num_encoder_layers‚6Bjjtttt_blocks_dnrp7hvvbs2s2ev0zj*jj-spatop-sweepagent-tttt-pairwise-1-8pwgvŠ ‹‡èÔ˜ÛóŸš3 (H¨¸hp"3.12.10*0.29.0j linux-x86_64az¹ò7 dnrp7hvv&  _runtime‚0  _wandb.runtime‚0ÿ:TiÒã -Linux-6.8.0-137-generic-x86_64-with-glibc2.36CPython 3.12.10 Š‡èÔˆÊãf*-of*=/data/spatop/options_files/sweep_tttt_jj/config_dnrp7hvv.json*-l* /scratch/logs*-n*jjtttt_blocks_dnrp7hvv2-m spanet.trainRjacksonjulian2014@gmail.comZ /scratch/logsb*jj-spatop-sweepagent-tttt-pairwise-1-8pwgvr/opt/conda/bin/pythonº 7cumxt8hjta3y4x8cvgc8quszz9q49ex}—ÉÒÀ€ˆ€’NVIDIA A100-SXM4-80GB˜¢ /€€€øáo€ Íöû\ª€àäêÞÂS NVIDIA A100-SXM4-80GB€€€€À€6"Ampere*(GPU-c1fdb213-5a16-84e3-13b4-cf29bc35dbf8Ê13.2º 7cumxt8hjta3y4x8cvgc8quszz9q49exµª½Ç2  requirements.txt•¡«QW dnrp7hvvZF (H¨¸ (H¨¸ (hpð"3.12.10*0.29.0j linux-x86_64¢ÏY dnrp7hvvZH (H¨¸ (H¨¸ (8hpð"3.12.10*0.29.0j linux-x86_64;ë(*  dnrp7hvvb trainer/global_step2S\  dnrp7hvvZK (H¨¸ (H¨¸(8hpð"3.12.10*0.29.0j linux-x86_647‡æ /  dnrp7hvvb*"trainer/global_step2uk–K  dnrp7hvvj: ‹‡èÔˆ¾Ô*LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0] ,ñÒÙ“  dnrp7hvvj  Œ‡èÔ ŠÔî â”â”â”â”┳â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”┳â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”┳â”â”â”â”â”â”â”â”┳â”â”â”â”â”â”â”┳â”â”â”â”â”â”â”┓ ┃ ┃ Name ┃ Type ┃ Params ┃ Mode ┃ FLOPs ┃ ┡â”â”â”╇â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”╇â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”╇â”â”â”â”â”â”â”â”╇â”â”â”â”â”â”â”╇â”â”â”â”â”â”â”┩ │ 0 │ embedding │ MultiInputVectorEmbed… │ 866 K │ train │ 0 │ │ 1 │ encoder │ JetEncoderWithPairwise │ 2.0 M │ train │ 0 │ │ 2 │ branch_decoders │ ModuleList │ 46.0 M │ train │ 0 │ │ 3 │ regression_decoder │ RegressionDecoder │ 0 │ train │ 0 │ │ 4 │ classification_decoder │ ClassificationDecoder │ 0 │ train │ 0 │ │ │ other params │ n/a │ 48 │ n/a │ n/a │ └───┴────────────────────────┴────────────────────────┴────────┴───────┴───────┘ ÁwäÍ\ dnrp7hvvjÊ Œ‡èÔÀ²ÎŽ·Trainable params: 48.8 M Non-trainable params: 86 Total params: 48.8 M Total estimated model params size (MB): 195.217 Modules in train mode: 5184 Modules in eval mode: 0 Total FLOPs: 0 ß„ïq dnrp7hvvj` Œ‡èÔ°„íŽPwandb: WARNING Config item 'hidden_dim' was locked by 'sweep' (ignored update). ¨Ç\ô{ dnrp7hvvjj Œ‡èÔèýöŽZwandb: WARNING Config item 'num_embedding_layers' was locked by 'sweep' (ignored update). NŸs$y dnrp7hvvjh Œ‡èÔÀ™€Xwandb: WARNING Config item 'num_encoder_layers' was locked by 'sweep' (ignored update). žúÉ€ dnrp7hvvjo Œ‡èԠ߈_wandb: WARNING Config item 'num_branch_encoder_layers' was locked by 'sweep' (ignored update). fURz dnrp7hvvji Œ‡èÔöYwandb: WARNING Config item 'num_attention_heads' was locked by 'sweep' (ignored update). }qUt dnrp7hvvjc Œ‡èÔˆ´™Swandb: WARNING Config item 'dataset_limit' was locked by 'sweep' (ignored update). ËùjÁq dnrp7hvvj` Œ‡èÔøÊ¡Pwandb: WARNING Config item 'batch_size' was locked by 'sweep' (ignored update). ‚4çt dnrp7hvvjc Œ‡èÔ˜Ò©Swandb: WARNING Config item 'learning_rate' was locked by 'sweep' (ignored update). vµ;Zn dnrp7hvvj] Œ‡èÔ á±Mwandb: WARNING Config item 'dropout' was locked by 'sweep' (ignored update). /×1©m dnrp7hvvj\ Œ‡èÔ€§ºLwandb: WARNING Config item 'epochs' was locked by 'sweep' (ignored update). Ê=Ü dnrp7hvv*Ê  transformer_dim‚128  transformer_dim_scale‚2.0  initial_embedding_dim‚128  position_embedding_dim‚128 ! num_branch_embedding_layers‚3  num_jet_embedding_layers‚0  num_jet_encoder_layers‚2  num_detector_layers‚2  num_regression_layers‚3  num_classification_layers‚3  split_symmetric_attention‚1 ! transformer_activation‚"gelu"  skip_connections‚1 ( "initial_embedding_skip_connections‚1  linear_block_type‚"GRU"  transformer_type‚"Gated"  linear_activation‚"gelu"  normalization‚ "LayerNorm"  masking‚ "Filling" linear_prelu_activation‚true  use_pairwise_interactions‚1  num_pairwise_features‚4  pairwise_embedding_dim‚8  pairwise_input_source‚"all"  pairwise_block_embeddings‚1  pairwise_cross_type‚true  pairwise_feature_set‚""  pairwise_eq2to2‚false  use_moe‚false  num_experts‚8  num_experts_per_tok‚2  moe_loss_scale‚0.01 F event_info_file‚2"/data/spatop/event_files/tttt/tttt_hadronic.yaml" = training_file‚+"/data/spatop/tttt_15M/h5/tttt_training.h5"  validation_file‚""  testing_file‚""  normalize_features‚1  limit_to_num_jets‚0  balance_particles‚0  balance_jets‚0 ! balance_classifications‚false  partial_events‚1  dataset_randomization‚0  train_validation_split‚0.95  limit_val_batches‚1.0  num_dataloader_workers‚0  mask_sequence_vectors‚1  combine_pair_loss‚"min"  optimizer‚"AdamW"  focal_gamma‚0.0  combinatorial_scale‚0.0 # learning_rate_warmup_epochs‚1.0  learning_rate_cycles‚1  assignment_loss_scale‚1.0  detection_loss_scale‚1.0  kl_loss_scale‚0.0  regression_loss_scale‚0.0 ! classification_loss_scale‚0.0 ! use_mass_classification‚false  mass_classes‚[]  balance_losses‚true  l2_penalty‚0.0002  gradient_clip‚10.0 num_gpu‚1  verbose_output‚false  usable_gpus‚""  trial_time‚"" $ trial_output_dir‚"./test_output"`ú›Vë dnrp7hvvjÙ Œ‡èÔ°ö²•È/opt/conda/lib/python3.12/site-packages/pytorch_lightning/utilities/_pytree.py:21: `isinstance(treespec, LeafSpec)` is deprecated, use `isinstance(treespec, TreeSpec) and treespec.is_leaf()` instead. ¯ÙÁ`N dnrp7hvvj¼ Œ‡èÔ؃ƕ«/opt/conda/lib/python3.12/site-packages/pytorch_lightning/trainer/connectors/data_connector.py:434: The 'val_dataloader' does not have many workers which may be a bottleneck. Consider increasing the value of the `num_workers` argument` to `num_workers=3` in the `DataLoader` to improve performance. Msa"ë dnrp7hvvjÙ ‡èÔ𿉀È/opt/conda/lib/python3.12/site-packages/pytorch_lightning/utilities/_pytree.py:21: `isinstance(treespec, LeafSpec)` is deprecated, use `isinstance(treespec, TreeSpec) and treespec.is_leaf()` instead. Ù—öÚP dnrp7hvvj¾ ‡èÔ˜²¥€­/opt/conda/lib/python3.12/site-packages/pytorch_lightning/trainer/connectors/data_connector.py:434: The 'train_dataloader' does not have many workers which may be a bottleneck. Consider increasing the value of the `num_workers` argument` to `num_workers=3` in the `DataLoader` to improve performance. L íøœ‚(:’ š‡èÔ§í© gpu.0.gpu‚30.0 gpu.0.memory‚5+ gpu.0.memoryAllocated‚30.66993713378906* gpu.0.memoryAllocatedBytes‚ 26345275392 gpu.0.temp‚39.0 gpu.0.powerWatts‚228.878' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚57.219500000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÓGÄ÷÷‚(:í š‡èÔóšÑ¬ network.sent‚32689 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.4453125 proc.cpu.threads‚17 disk.sda.out‚ 2.21142578125 disk.nvme0n1.in‚0 disk.sdb2.in‚0) disk./.usagePercent‚83.15220270211232 disk.sda1.out‚0 disk.nvme1n1.out‚ 97.91015625 disk.sdb.in‚0 disk.sdb2.out‚ 2.21142578125 disk.rbd0.in‚0 disk.dm-0.out‚ 242.046875 disk.sdb.out‚ 2.21142578125 disk.md0.out‚2.140625 disk.md0p1.in‚0 disk.md0p1.out‚2.140625" proc.memory.rssMB‚ 2994.1796875 disk.sda2.in‚0 disk.sda2.out‚ 2.21142578125 disk.md0.in‚0 disk.dm-0.in‚ 32.4453125$ memory_percent‚52.95124053955078 network.recv‚41056 disk.rbd2.in‚0 disk.rbd2.out‚0 disk.sda.in‚0! disk.nvme0n1.out‚ 144.13671875 disk.rbd0.out‚0$ disk./.usageGB‚2973.925537109375 disk.sdb1.in‚0 disk.sdb1.out‚0& proc.memory.availableMB‚ 7708.46875* proc.memory.percent‚18.275022506713867 cpu‚21.169665327631723þOpÅ“ ‚(:‰ ©‡èÔ˜Äé© gpu.0.gpu‚57.0 gpu.0.memory‚10+ gpu.0.memoryAllocated‚30.66993713378906* gpu.0.memoryAllocatedBytes‚ 26345275392 gpu.0.temp‚42.0 gpu.0.powerWatts‚230.097' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.52425 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¯¾€Œÿ!‚(:õ ©‡èÔ‰¦çª) disk./.usagePercent‚83.16252584171372 disk.sda2.in‚0 disk.sda1.out‚0% memory_percent‚54.007935523986816 cpu‚22.149795740980334 disk.sda1.in‚0 disk.nvme1n1.out‚ 202.421875" proc.memory.rssMB‚ 2994.3515625! disk.nvme0n1.out‚ 265.56640625 disk.rbd0.in‚0 network.recv‚73989 disk.rbd2.in‚0 disk.dm-0.in‚ 32.44921875 disk.dm-0.out‚ 467.98828125* proc.memory.percent‚18.276071548461914 disk.sdb2.in‚0 disk.sda2.out‚ 3.7861328125 disk.sdb1.in‚0 disk.sda.out‚ 3.7861328125 disk.nvme0n1.in‚0 disk.nvme1n1.in‚ 32.44921875 disk.md0p1.out‚ 3.66015625 disk.sdb1.out‚0 disk.sda.in‚0 disk.sdb.in‚0 proc.cpu.threads‚17 disk.md0p1.in‚0 disk.rbd0.out‚0% disk./.usageGB‚2974.2947425842285 disk.sdb2.out‚ 3.7861328125 disk.md0.in‚0 disk.sdb.out‚ 3.7861328125) proc.memory.availableMB‚ 7535.33984375 network.sent‚58328 disk.md0.out‚ 3.66015625 disk.rbd2.out‚0­½º-“"‚(:‰ ¸‡èÔÙ•« gpu.0.gpu‚86.0 gpu.0.memory‚21+ gpu.0.memoryAllocated‚30.66993713378906* gpu.0.memoryAllocatedBytes‚ 26345275392 gpu.0.temp‚42.0 gpu.0.powerWatts‚229.587' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.39675 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÿ,þ»ü#‚(:ò ¸‡èÔÀÑõ« disk.sdb2.out‚ 5.3779296875 disk.sda2.in‚0 disk.rbd2.in‚0 disk.rbd2.out‚0! proc.memory.rssMB‚ 2994.359375* proc.memory.percent‚18.276119232177734 proc.cpu.threads‚17) disk./.usagePercent‚83.16252701497957 disk.dm-0.in‚ 32.44921875 disk.dm-0.out‚ 508.20703125 disk.sda.in‚0$ memory_percent‚54.00965213775635 cpu‚22.763768610796447 disk.sdb2.in‚0 disk.md0p1.in‚0 disk.sda.out‚ 5.3779296875 disk.sda1.out‚0! disk.nvme0n1.out‚ 265.66796875) proc.memory.availableMB‚ 7535.05859375 network.recv‚78170% disk./.usageGB‚2974.2947845458984 disk.sda2.out‚ 5.3779296875 disk.md0p1.out‚ 5.1796875 disk.sdb.in‚0 disk.sdb.out‚ 5.3779296875 disk.sdb1.in‚0 disk.nvme0n1.in‚0 network.sent‚66064 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.44921875 disk.md0.out‚ 5.1796875 disk.rbd0.in‚0 disk.sda1.in‚0 disk.nvme1n1.out‚ 242.5390625 disk.md0.in‚0 disk.rbd0.out‚03c€Ï3$b/ lr-AdamW/pg1"trainer/global_step2:JP˜‰7&3%b/ lr-AdamW/pg2"trainer/global_step2:JPªèƒŠ-&) _wandbruntime‚51  _runtime‚51„z;'¹ trainer/global_step‚49 % _timestamp‚1.7884783998395452e+09 _runtime‚ 51.949991734 _step‚0 % lr-AdamW/pg1‚9.70449660829886e-05 % lr-AdamW/pg2‚9.70449660829886e-05è°d'À(» % lr-AdamW/pg1‚9.70449660829886e-05 % lr-AdamW/pg2‚9.70449660829886e-05 trainer/global_step‚49 % _timestamp‚1.7884783998395452e+09 _runtime‚ 51.949991734 _step‚0?߀d)b` =DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak"trainer/global_step2:JP.ÿ^k*bg DDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated"trainer/global_step2:JPTOˆav+br ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current"trainer/global_step2:JP˜¾7j,bf CDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed"trainer/global_step2:JPùÄoq-bm JDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current"trainer/global_step2:JPîjÓ§r.bn KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated"trainer/global_step2:JPW³—Õn/bj GDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed"trainer/global_step2:JP‹¶´”o0bk HDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed"trainer/global_step2:JP%æÕm1bi FDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed"trainer/global_step2:JPÛlYØn2bj GDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current"trainer/global_step2:JP}Xk3bg DDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak"trainer/global_step2:JPÚ-H%o4bk HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed"trainer/global_step2:JPàQõ_b5b^ ;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak"trainer/global_step2:JPóºÃn6bj GDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated"trainer/global_step2:JP4«RMl7bh EDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated"trainer/global_step2:JPG^  _8b[ 8DeviceStatsMonitor.on_train_batch_start/active.all.freed"trainer/global_step2:JP¨ n9bj GDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak"trainer/global_step2:JP~Å÷¾^:bZ 7DeviceStatsMonitor.on_train_batch_start/num_device_free"trainer/global_step2:JPÛ²9Ãs;bo LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated"trainer/global_step2:JP¸©zljbd ADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak"trainer/global_step2:JP•²çc?b_ DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak"trainer/global_step2:JPã9J»oJbk HDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current"trainer/global_step2:JP’Ž?®nKbj GDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed"trainer/global_step2:JP輇óaLb] :DeviceStatsMonitor.on_train_batch_start/active.all.current"trainer/global_step2:JP諲…pMbl IDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current"trainer/global_step2:JPµøÌm]NbY 6DeviceStatsMonitor.on_train_batch_start/max_split_size"trainer/global_step2:JPÂî/jObf CDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated"trainer/global_step2:JPyúgafPbb ?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed"trainer/global_step2:JPŠg™sQbo LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated"trainer/global_step2:JPX·ÁpRbl IDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current"trainer/global_step2:JP÷¶ gSbc @DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed"trainer/global_step2:JP©Q‡‰xTbt QDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated"trainer/global_step2:JP¦º‘òvUbr ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current"trainer/global_step2:JP Ø!jVbf CDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current"trainer/global_step2:JPÑ3/gWbc @DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed"trainer/global_step2:JP©–ÖöjXbf CDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated"trainer/global_step2:JPSeveYba >DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed"trainer/global_step2:JPñý¶tZbp MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed"trainer/global_step2:JP˜Þ,7s[bo LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak"trainer/global_step2:JP “îq\bm JDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current"trainer/global_step2:JPd‹`]b\ 9DeviceStatsMonitor.on_train_batch_start/segment.all.freed"trainer/global_step2:JP1ˆch^bd ADeviceStatsMonitor.on_train_batch_start/active.large_pool.current"trainer/global_step2:JP)%äŠg_bc @DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current"trainer/global_step2:JP«)ìk`bg DDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current"trainer/global_step2:JPf>W]oabk HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed"trainer/global_step2:JP¾w»hbbd ADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed"trainer/global_step2:JPzÂFncbj GDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak"trainer/global_step2:JPáˆe|fdbb ?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak"trainer/global_step2:JPDÔÝ[gebc @DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed"trainer/global_step2:JPð8¶pfbl IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated"trainer/global_step2:JPUŠççggbc @DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak"trainer/global_step2:JPèTšRqhbm JDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current"trainer/global_step2:JPsí—Llibh EDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current"trainer/global_step2:JPÊ©KŒnjbj GDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed"trainer/global_step2:JPy;4mkbi FDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak"trainer/global_step2:JP>zûqlbm JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated"trainer/global_step2:JP-] º`mb\ 9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries"trainer/global_step2:JP¨eífnbb ?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak"trainer/global_step2:JPU•eoba >DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak"trainer/global_step2:JP^ànpbj GDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current"trainer/global_step2:JPªÔŒWeqba >DeviceStatsMonitor.on_train_batch_start/allocation.all.current"trainer/global_step2:JPºæirbe BDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak"trainer/global_step2:JPW^óƒrsbn KDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated"trainer/global_step2:JP#»óntbj GDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed"trainer/global_step2:JPM¼®mubi FDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak"trainer/global_step2:JP£&é,fvbb ?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed"trainer/global_step2:JP• 5µhwbd ADeviceStatsMonitor.on_train_batch_start/active.small_pool.current"trainer/global_step2:JPn:küoxbk HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed"trainer/global_step2:JPDé‹Ásybo LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated"trainer/global_step2:JPU`jzbf CDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed"trainer/global_step2:JP³…–ô_{b[ 8DeviceStatsMonitor.on_train_batch_start/num_device_alloc"trainer/global_step2:JP.+Ve|ba >DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak"trainer/global_step2:JP;Ö{ l}bh EDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated"trainer/global_step2:JPÓ;q¯i~be BDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak"trainer/global_step2:JP¡“vjbf CDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current"trainer/global_step2:JPÛ{bs€bn KDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated"trainer/global_step2:JPÈ/;¶qbl IDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current"trainer/global_step2:JP953`‚b[ 8DeviceStatsMonitor.on_train_batch_start/segment.all.peak"trainer/global_step2:JP6¹M’bƒb] :DeviceStatsMonitor.on_train_batch_start/num_oom_rejections"trainer/global_step2:JPm5çj„be BDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current"trainer/global_step2:JPê*Œ¤j…be BDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current"trainer/global_step2:JP@Ïö h†bc @DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak"trainer/global_step2:JP» U¾j‡be BDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current"trainer/global_step2:JP©!Ujoˆbj GDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak"trainer/global_step2:JPkcVšn‰bi FDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak"trainer/global_step2:JPœ‚hlŠbg DDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated"trainer/global_step2:JPã¶Z_‹bZ 7DeviceStatsMonitor.on_train_batch_start/active.all.peak"trainer/global_step2:JP´<_ºsŒbn KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated"trainer/global_step2:JPéÅ5•eb` =DeviceStatsMonitor.on_train_batch_start/segment.all.allocated"trainer/global_step2:JPßjŽbe BDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current"trainer/global_step2:JP[H7mbh EDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed"trainer/global_step2:JP 62jgbb ?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak"trainer/global_step2:JP. Ë–d‘b_ DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26870 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚540135 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 994050048 J?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚881788 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚ 6679497868288 \LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 54130318336 NCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚881788 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1783 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚ 6733645225984 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26870 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚253034 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1783 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25792872448 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚474 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940825088 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚528 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414460 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27137 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1783 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚ 6679497868288 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1727 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚ 51.954810367 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185807872 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚ 6573867254288 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 994050048 K@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚792641 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚ 5766331614208 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 trainer/global_step‚49 NCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚881790 P>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚ 6732845372416 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚ 5766306710528 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 % _timestamp‚1.7884783998409352e+09GÃôÿŸ'¦™O D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚ 6573867254288 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 994050048 K@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚792641 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚ 5766331614208 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 trainer/global_step‚49 NCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚881790 P>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚ 6732845372416 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚ 5766306710528 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 % _timestamp‚1.7884783998409352e+09 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚ 6573850214928 SADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚ 6732845372416 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976774144 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 54130318336 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098509 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 RGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚252509 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚984 \JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚ 5825341943296 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚474 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26870 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚540135 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 994050048 J?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚881788 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚ 6679497868288 \LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 54130318336 NCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚881788 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1783 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚ 6733645225984 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26870 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚253034 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1783 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25792872448 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚474 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940825088 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚528 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414460 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27137 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1783 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚ 6679497868288 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1727 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚ 51.954810367 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185807872 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0ã³;l§bg DDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated"trainer/global_step2:JPóm.p¨bk HDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current"trainer/global_step2:JP¯‡Ÿg©bb ?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed"trainer/global_step2:JPjµ×Olªbg DDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak"trainer/global_step2:JP4^5`«b[ 8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections"trainer/global_step2:JP†˜÷f¬ba >DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak"trainer/global_step2:JPÚž»Æu­bp MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current"trainer/global_step2:JP|xâ^®bY 6DeviceStatsMonitor.on_train_batch_end/num_device_alloc"trainer/global_step2:JPÇã‚ k¯bf CDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated"trainer/global_step2:JP®§žIj°be BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated"trainer/global_step2:JP +‹^±bY 6DeviceStatsMonitor.on_train_batch_end/segment.all.peak"trainer/global_step2:JPà÷ ój²be BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated"trainer/global_step2:JPcbìTf³ba >DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed"trainer/global_step2:JPr»Ôse´b` =DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak"trainer/global_step2:JP‚ÀÐmµbh EDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak"trainer/global_step2:JP„–Xk¶bf CDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current"trainer/global_step2:JP¹Ôy•o·bj GDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current"trainer/global_step2:JPP4ƒ3m¸bh EDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed"trainer/global_step2:JP ˜ÐÅl¹bg DDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak"trainer/global_step2:JP©ézUkºbf CDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak"trainer/global_step2:JPi¹ìÚr»bm JDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak"trainer/global_step2:JPç™Üg¼bb ?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current"trainer/global_step2:JP ZF9k½bf CDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed"trainer/global_step2:JPý¨d"q¾bl IDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated"trainer/global_step2:JP¡¼çq¿bl IDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated"trainer/global_step2:JPVë‡qÀbl IDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated"trainer/global_step2:JP°Œ ÅlÁbg DDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak"trainer/global_step2:JP½zƒ#jÂbe BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated"trainer/global_step2:JPáÿ§hÃbc @DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated"trainer/global_step2:JPÆÿfiÄbd ADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current"trainer/global_step2:JP¯ ZòfÅba >DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak"trainer/global_step2:JPS0¨iÆbd ADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated"trainer/global_step2:JP n‡–mÇbh EDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current"trainer/global_step2:JP±ÙfÈba >DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed"trainer/global_step2:JPˆäµ›hÉbc @DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed"trainer/global_step2:JPSCz pÊbk HDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current"trainer/global_step2:JPÚïz mËbh EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed"trainer/global_step2:JP’1å=jÌbe BDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak"trainer/global_step2:JPŸ”ÈjÍbe BDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak"trainer/global_step2:JP‰>oÎbj GDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current"trainer/global_step2:JPg7lŽsÏbn KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed"trainer/global_step2:JPXÔ9¢rÐbm JDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak"trainer/global_step2:JP{ÎÃ]ÑbX 5DeviceStatsMonitor.on_train_batch_end/num_device_free"trainer/global_step2:JPÉ¡¡fÒba >DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed"trainer/global_step2:JPáÑ'ÂmÓbh EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak"trainer/global_step2:JP±?„dÔb_ DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed"trainer/global_step2:JPkU›bÜb] :DeviceStatsMonitor.on_train_batch_end/active.all.allocated"trainer/global_step2:JP'i;kÝbf CDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated"trainer/global_step2:JP6cnÞbi FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed"trainer/global_step2:JPa­ipßbk HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated"trainer/global_step2:JP8ùÎ!ràbm JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated"trainer/global_step2:JP±¡dáb_ DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current"trainer/global_step2:JP2ç±mýbh EDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current"trainer/global_step2:JPº{pwjþbe BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated"trainer/global_step2:JPWGj¯iÿbd ADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated"trainer/global_step2:JPš™aYm€bh EDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated"trainer/global_step2:JP¹µ‚gbb ?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak"trainer/global_step2:JP<#àÍe‚b` =DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak"trainer/global_step2:JPL³kâiƒbd ADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated"trainer/global_step2:JP³Õào„bj GDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated"trainer/global_step2:JP30îi…bd ADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed"trainer/global_step2:JPW°­h†bc @DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current"trainer/global_step2:JP÷jÃ^‡bY 6DeviceStatsMonitor.on_train_batch_end/active.all.freed"trainer/global_step2:JP¾[Mkˆbf CDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed"trainer/global_step2:JP^m‚r‰bm JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated"trainer/global_step2:JPG5ËnŠbi FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed"trainer/global_step2:JPFùf‹ba >DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated"trainer/global_step2:JPçP*iuŒbp MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current"trainer/global_step2:JP¨¤‚]db_ DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚474 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 994050048 PEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚550892 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3107757568 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚ 6812249180160 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚550895 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚258020 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 994050048 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 994050048 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚474 R@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚ 6867462889984 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚1124970 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 I>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚808400 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚ 5880450513408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚2024212 UCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚ 6867462889984 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚ 6812249180160 ZHDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚ 5940634201600 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚ 6704517455328 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚808915 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 trainer/global_step‚49 PEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚899242 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25792872448 LADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚899242 WGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 55196670464 LADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚899240 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚2002206 SCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 54413842944 ZJDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 55196670464 VFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 54413842944 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚2024212 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 152502272 N8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680<Äq©&¤£M UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚2024212 UCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚ 6867462889984 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚ 6812249180160 ZHDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚ 5940634201600 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚ 6704517455328 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚808915 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 trainer/global_step‚49 PEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚899242 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25792872448 LADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚899242 WGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 55196670464 LADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚899240 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚2002206 SCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 54413842944 ZJDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 55196670464 VFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 54413842944 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚2024212 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 152502272 N8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1783 UCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚ 6759527717494 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25792872448 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1783 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚474 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 994050048 PEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚550892 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3107757568 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚ 6812249180160 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚550895 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚258020 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 994050048 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 994050048 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚474 R@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚ 6867462889984 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚1124970 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 I>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚808400 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚ 5880450513408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0qE*A¥b< loss/FRt1/assignment_loss"trainer/global_step2:JPÝ&’A¦b< loss/FRt2/assignment_loss"trainer/global_step2:JP’˜oB§b= loss/SRqqt1/detection_loss"trainer/global_step2:JPØdì7¨b2 loss/total_loss"trainer/global_step2:JP†|MB©b= loss/SRqqt2/detection_loss"trainer/global_step2:JPþQk˜Bªb= loss/SRqqt3/detection_loss"trainer/global_step2:JPÃó-¾@«b; loss/FBt4/detection_loss"trainer/global_step2:JPüûù[A¬b< loss/FBt3/assignment_loss"trainer/global_step2:JPÈ20ßC­b> loss/SRqqt2/assignment_loss"trainer/global_step2:JP^Ñ;ìB®b= loss/SRqqt4/detection_loss"trainer/global_step2:JP±\ÿÝ-¯b( epoch"trainer/global_step2:JP©Óo²A°b< loss/FBt2/assignment_loss"trainer/global_step2:JP_¼ó@±b; loss/FRt3/detection_loss"trainer/global_step2:JPó JóA²b< loss/FRt4/assignment_loss"trainer/global_step2:JPwegSC³b> loss/SRqqt3/assignment_loss"trainer/global_step2:JP>aÿ_C´b> loss/SRqqt4/assignment_loss"trainer/global_step2:JPùn?;Aµb< loss/FBt1/assignment_loss"trainer/global_step2:JP–OàK@¶b; loss/FBt1/detection_loss"trainer/global_step2:JP>RÊQ@·b; loss/FBt2/detection_loss"trainer/global_step2:JPÎÅxC¸b> loss/SRqqt1/assignment_loss"trainer/global_step2:JPuÞ@¹b; loss/FRt1/detection_loss"trainer/global_step2:JPãæ•ÿ@ºb; loss/FBt3/detection_loss"trainer/global_step2:JPÝ‚ŠôA»b< loss/FBt4/assignment_loss"trainer/global_step2:JPtÐìïA¼b< loss/FRt3/assignment_loss"trainer/global_step2:JP¶4b˜@½b; loss/FRt4/detection_loss"trainer/global_step2:JP:e…ü@¾b; loss/FRt2/detection_loss"trainer/global_step2:JPŠU/.¿) _wandbruntime‚52  _runtime‚52=„•²MÀÇ /loss/FRt4/assignment_loss‚7.387229549351023 1loss/SRqqt3/assignment_loss‚5.529901773114748 1loss/SRqqt4/assignment_loss‚5.390908807516098 0loss/FBt1/assignment_loss‚2.1127096103585283 /loss/FBt1/detection_loss‚14.597739412732746 .loss/FBt2/detection_loss‚11.82111120737832 1loss/SRqqt1/assignment_loss‚5.352443863363827 /loss/FRt1/detection_loss‚2.4907671497392703 /loss/FBt3/detection_loss‚10.543239158523434 /loss/FBt4/assignment_loss‚1.948355043036306 /loss/FRt3/assignment_loss‚7.487671044495729 .loss/FRt4/detection_loss‚5.220904023122432 _runtime‚ 52.809214346 /loss/FRt2/detection_loss‚5.1334277311408965 trainer/global_step‚49 /loss/FRt1/assignment_loss‚7.169261816071301 0loss/FRt2/assignment_loss‚7.3260937266879615 1loss/SRqqt1/detection_loss‚2.8310980933303593 &loss/total_loss‚128.38674685366666 0loss/SRqqt2/detection_loss‚5.615276601959447 1loss/SRqqt3/detection_loss‚1.6411140861145892 .loss/FBt4/detection_loss‚2.203935814852245 0loss/FBt3/assignment_loss‚1.9962737630395329 2loss/SRqqt2/assignment_loss‚5.4326354480180585 0loss/SRqqt4/detection_loss‚4.251794409938157 epoch‚0 0loss/FBt2/assignment_loss‚1.8523261300448715 .loss/FRt3/detection_loss‚3.050528589736771 % _timestamp‚1.7884784006983757e+09 _step‚3ëC3QÁË /loss/FRt1/assignment_loss‚7.169261816071301 0loss/FRt2/assignment_loss‚7.3260937266879615 1loss/SRqqt1/detection_loss‚2.8310980933303593 &loss/total_loss‚128.38674685366666 0loss/SRqqt2/detection_loss‚5.615276601959447 1loss/SRqqt3/detection_loss‚1.6411140861145892 .loss/FBt4/detection_loss‚2.203935814852245 0loss/FBt3/assignment_loss‚1.9962737630395329 2loss/SRqqt2/assignment_loss‚5.4326354480180585 0loss/SRqqt4/detection_loss‚4.251794409938157 epoch‚0 0loss/FBt2/assignment_loss‚1.8523261300448715 .loss/FRt3/detection_loss‚3.050528589736771 % _timestamp‚1.7884784006983757e+09 _step‚3 /loss/FRt4/assignment_loss‚7.387229549351023 1loss/SRqqt3/assignment_loss‚5.529901773114748 1loss/SRqqt4/assignment_loss‚5.390908807516098 0loss/FBt1/assignment_loss‚2.1127096103585283 /loss/FBt1/detection_loss‚14.597739412732746 .loss/FBt2/detection_loss‚11.82111120737832 1loss/SRqqt1/assignment_loss‚5.352443863363827 /loss/FRt1/detection_loss‚2.4907671497392703 /loss/FBt3/detection_loss‚10.543239158523434 /loss/FBt4/assignment_loss‚1.948355043036306 /loss/FRt3/assignment_loss‚7.487671044495729 .loss/FRt4/detection_loss‚5.220904023122432 _runtime‚ 52.809214346 /loss/FRt2/detection_loss‚5.1334277311408965 trainer/global_step‚49žâÑ‚(:ö LJèÔÌó‘« disk.rbd2.out‚0 disk.sda1.in‚0$ memory_percent‚54.04016971588135* proc.memory.percent‚18.276286125183105) disk./.usagePercent‚83.16258194515362 disk.sda2.out‚ 7.47216796875 disk.sda.out‚ 7.47216796875 disk.nvme0n1.in‚0 proc.cpu.threads‚17 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda.in‚0 disk.sdb.out‚ 7.47216796875 disk.md0.in‚0 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.453125 cpu‚23.195303897553313 network.sent‚91259 network.recv‚111222 disk.rbd0.out‚0 disk.nvme0n1.out‚ 266.609375 disk.sdb.in‚0) proc.memory.availableMB‚ 7530.05859375! disk.nvme1n1.out‚ 300.87890625 disk.sdb2.in‚0% disk./.usageGB‚2974.2967491149902 disk.md0p1.in‚0# proc.memory.rssMB‚ 2994.38671875 disk.md0.out‚ 7.21484375 disk.md0p1.out‚ 7.21484375 disk.dm-0.in‚ 32.453125 disk.sdb2.out‚ 7.47216796875 disk.sda2.in‚0 disk.dm-0.out‚ 567.48828125øsBœÃ‚(:‘ LJèÔÅßì« gpu.0.gpu‚14.0 gpu.0.memory‚4+ gpu.0.memoryAllocated‚30.66993713378906* gpu.0.memoryAllocatedBytes‚ 26345275392 gpu.0.temp‚41.0 gpu.0.powerWatts‚217.398' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚54.34949999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0) bžÄ‚(:“ Ö‡èÔ’¦µ« gpu.0.gpu‚75.0 gpu.0.memory‚12+ gpu.0.memoryAllocated‚30.66993713378906* gpu.0.memoryAllocatedBytes‚ 26345275392 gpu.0.temp‚40.0 gpu.0.powerWatts‚119.978' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚29.994499999999995 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0©õûÅ‚(:ð Ö‡èÔ ³Ê« disk.sdb1.in‚0! disk.nvme0n1.out‚ 268.05078125 proc.cpu.threads‚17 disk.sda2.out‚ 9.12353515625 disk.md0.out‚ 8.80859375 disk.rbd0.in‚0 disk.sda.out‚ 9.12353515625 disk.dm-0.out‚ 702.16796875 disk.sda.in‚0 disk.sdb.in‚0 disk.sdb2.out‚ 9.12353515625! proc.memory.rssMB‚ 2994.390625$ disk./.usageGB‚2974.172954559326 disk.rbd2.in‚0 disk.nvme1n1.in‚ 32.453125' proc.memory.availableMB‚ 7531.078125 network.sent‚142061 network.recv‚116702 disk.rbd0.out‚0 disk.dm-0.in‚ 32.453125 disk.rbd2.out‚0 disk.nvme0n1.in‚0* proc.memory.percent‚18.276309967041016 disk.md0p1.out‚ 8.80859375# memory_percent‚54.0339469909668 disk.sda2.in‚0 disk.md0p1.in‚0 disk.sdb1.out‚0 disk.sda1.out‚0 disk.nvme1n1.out‚ 434.1171875 disk.sdb.out‚ 9.12353515625 disk.sdb2.in‚0( disk./.usagePercent‚83.1591205975652 disk.md0.in‚0 disk.sda1.in‚0 cpu‚23.49882670345697úȹ’Æ‚(:‡ å‡èԠɆ« gpu.0.gpu‚86.0 gpu.0.memory‚21+ gpu.0.memoryAllocated‚30.66993713378906* gpu.0.memoryAllocatedBytes‚ 26345275392 gpu.0.temp‚39.0 gpu.0.powerWatts‚124.044' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚31.011 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0VÿlsÇ‚(:ö å‡èÔ“ž®« network.sent‚147711! disk.nvme1n1.out‚ 608.64453125 disk.sdb2.out‚10.71337890625 disk.md0.out‚ 10.3359375 disk.md0p1.in‚0# memory_percent‚54.0363073348999) proc.memory.availableMB‚ 7530.69140625$ disk./.usageGB‚2974.296642303467 disk.nvme0n1.in‚0 disk.sda2.in‚0 disk.sdb2.in‚0 disk.rbd2.out‚0 disk.sda.in‚0 proc.cpu.threads‚17 disk.nvme1n1.in‚ 32.453125 disk.rbd0.out‚0 cpu‚23.74042844625181 disk.sdb1.out‚0! disk.nvme0n1.out‚ 268.40234375 disk.sdb.in‚0 disk.md0.in‚0 disk.md0p1.out‚ 10.3359375 disk.dm-0.in‚ 32.453125 disk.dm-0.out‚ 877.046875 disk.sda1.out‚0 network.recv‚122409 disk.sda2.out‚10.71337890625 disk.rbd2.in‚0 disk.sdb1.in‚0* proc.memory.percent‚18.276309967041016) disk./.usagePercent‚83.16257895865871 disk.sdb.out‚10.71337890625 disk.sda.out‚10.71337890625 disk.sda1.in‚0! proc.memory.rssMB‚ 2994.390625 disk.rbd0.in‚0clÐe0È+ _wandbruntime‚101  _runtime‚101F…;Äɾ trainer/global_step‚99 % _timestamp‚1.7884784492455537e+09 _runtime‚ 101.355877149 _step‚4 ' lr-AdamW/pg1‚0.00019607044167787495 ' lr-AdamW/pg2‚0.00019607044167787495*ÞïÈÊ % _timestamp‚1.7884784492455537e+09 _runtime‚ 101.355877149 _step‚4 ' lr-AdamW/pg1‚0.00019607044167787495 ' lr-AdamW/pg2‚0.00019607044167787495 trainer/global_step‚99Ìq[Þ0Ë+ _wandbruntime‚101  _runtime‚101į¡‚Õ̶O OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚1754390 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 107475087360 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚2169030 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 % _timestamp‚1.7884784492463336e+09 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚13424555588608 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 106692273152 L@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚3945398 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 116550172672 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 HDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 116711076864 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185807872 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚2191008 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 107475087360 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚11590047027200 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 106692273152 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚503795 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚984 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3107757568 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚1754388 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚11473496854528 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚ 101.356770053 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚13317080501248 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 D8DeviceStatsMÁ£ãç onitor.on_train_batch_start/active.all.freed‚3923418 HDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚1581930 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚13424555588608 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚1078135 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 106330479380 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚13423755735040 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚2191008 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚11473521758208 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚13212690746308&ßZjÀ'ͺO H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 106692273152 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚503795 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚984 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3107757568 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚1754388 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚11473496854528 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚ 101.356770053 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚13317080501248 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 D8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚3923418 HDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚1581930 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚13424555588608 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚1078135 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 106330479380 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚13423755735040 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚2191008 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚11473521758208 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚13212690746308 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚1754390 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 107475087360 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚2169030 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 % _timestamp‚1.7884784492463336e+09 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚13424555588608 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 106692273152 L@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚3945398 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 116550172672 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 HDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 116711076864 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185807872 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚2191008 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 107475087360 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚11590047027200 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0o†èó0Î+ _wandbruntime‚102  _runtime‚102e¡cÆ&ÏÀM E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 PEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚508268 _runtime‚ 102.208658718 O8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚3962558 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 108174700474 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚13558373252608 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚11705525683712 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183697408 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚13449831813120 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 % _timestamp‚1.7884784500970867e+09 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚518 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚3984564 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚1771840 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚1771842 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚2212722 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 117701328896 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚13557573385728 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3107757568 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚13449814773760 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 108541439488 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚508783 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚1088895 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚1771842 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚984 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚11587665561088 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _step‚6 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 J>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚1597160 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚1088892 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚1597678 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 trainer/global_step‚99 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚2190718 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚515 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1727 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚2190718 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 107758611968 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158793728 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚13237027507328 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 108541439488 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚11587640657408 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚3984564 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 107758611968 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200ò•EÊ&ÐÄM B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚2212722 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 117701328896 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚13557573385728 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3107757568 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚13449814773760 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 108541439488 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚508783 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚1088895 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚1771842 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚984 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚11587665561088 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _step‚6 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 J>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚1597160 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚1088892 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚1597678 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 trainer/global_step‚99 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚2190718 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚515 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1727 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚2190718 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 107758611968 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158793728 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚13237027507328 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 108541439488 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚11587640657408 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚3984564 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 107758611968 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 PEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚508268 _runtime‚ 102.208658718 O8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚3962558 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 108174700474 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚13558373252608 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚11705525683712 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183697408 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚13449831813120 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 % _timestamp‚1.7884784500970867e+09 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚518 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚3984564 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚1771840 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚1771842ªNùê0Ñ+ _wandbruntime‚102  _runtime‚102ž“ÏÙ8ÒÇ 1loss/FBt2/assignment_loss‚0.4897714306028016íͱ5 &loss/total_loss‚117.76361696133296 0loss/FBt1/assignment_loss‚0.2821401462251043 1loss/FBt3/assignment_loss‚0.36506699953813376 1loss/SRqqt2/detection_loss‚15.019489292217338 1loss/SRqqt3/detection_loss‚2.9368072019442795 1loss/SRqqt1/detection_loss‚2.2311180627150256 trainer/global_step‚99 1loss/SRqqt1/assignment_loss‚3.461258456654792 .loss/FRt3/detection_loss‚3.828804109990597 /loss/FRt4/detection_loss‚2.6122221633676412 $ _timestamp‚1.788478450099569e+09 _runtime‚ 102.209823303 _step‚7 /loss/FRt3/assignment_loss‚7.391236612531874 .loss/FRt2/assignment_loss‚7.16403128306071 1loss/SRqqt2/assignment_loss‚5.361406968987507 /loss/FRt1/detection_loss‚2.8669601080210314 .loss/FBt2/detection_loss‚11.05474798878034 1loss/SRqqt4/assignment_loss‚3.489074488599857 0loss/FBt4/assignment_loss‚0.8387819510501098 -loss/FRt2/detection_loss‚6.33300601641337 0loss/SRqqt4/detection_loss‚1.820270116591525 /loss/FBt1/detection_loss‚12.304498967069845 .loss/FBt4/detection_loss‚6.257970387232159 epoch‚0 .loss/FRt4/assignment_loss‚7.34224515367848 /loss/FBt3/detection_loss‚3.1394083314036068 0loss/FRt1/assignment_loss‚7.2243335184843644 1loss/SRqqt3/assignment_loss‚3.948967206172454Õï@QÓË /loss/FRt3/assignment_loss‚7.391236612531874 .loss/FRt2/assignment_loss‚7.16403128306071 1loss/SRqqt2/assignment_loss‚5.361406968987507 /loss/FRt1/detection_loss‚2.8669601080210314 .loss/FBt2/detection_loss‚11.05474798878034 1loss/SRqqt4/assignment_loss‚3.489074488599857 0loss/FBt4/assignment_loss‚0.8387819510501098 -loss/FRt2/detection_loss‚6.33300601641337 0loss/SRqqt4/detection_loss‚1.820270116591525 /loss/FBt1/detection_loss‚12.304498967069845 .loss/FBt4/detection_loss‚6.257970387232159 epoch‚0 .loss/FRt4/assignment_loss‚7.34224515367848 /loss/FBt3/detection_loss‚3.1394083314036068 0loss/FRt1/assignment_loss‚7.2243335184843644 1loss/SRqqt3/assignment_loss‚3.948967206172454 1loss/FBt2/assignment_loss‚0.48977143060280165 &loss/total_loss‚117.76361696133296 0loss/FBt1/assignment_loss‚0.2821401462251043 1loss/FBt3/assignment_loss‚0.36506699953813376 1loss/SRqqt2/detection_loss‚15.019489292217338 1loss/SRqqt3/detection_loss‚2.9368072019442795 1loss/SRqqt1/detection_loss‚2.2311180627150256 trainer/global_step‚99 1loss/SRqqt1/assignment_loss‚3.461258456654792 .loss/FRt3/detection_loss‚3.828804109990597 /loss/FRt4/detection_loss‚2.6122221633676412 $ _timestamp‚1.788478450099569e+09 _runtime‚ 102.209823303 _step‚7:ø|˜ŸÔ‚(:” ô‡èÔñïõª gpu.0.gpu‚82.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚207.152' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚51.788000000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0/Ž˜1Õ‚(:ö ô‡èÔœŒ« disk.sdb2.in‚0 disk.sda2.in‚0$ memory_percent‚54.03904914855957 cpu‚23.925424061451704 disk.sdb1.in‚0 disk.nvme0n1.in‚0 disk.rbd2.in‚0# proc.memory.rssMB‚ 2994.39453125 network.sent‚152337 disk.dm-0.in‚ 32.453125* proc.memory.percent‚18.276333808898926 disk.sdb.out‚12.24267578125 disk.md0.in‚0 disk.rbd2.out‚0 proc.cpu.threads‚17 disk.nvme0n1.out‚ 268.5234375 disk.sda2.out‚12.24267578125 disk.md0.out‚ 11.8046875 disk.md0p1.in‚0 disk.sdb1.out‚0 disk.sda1.in‚0 disk.md0p1.out‚ 11.8046875 disk.rbd0.out‚0 network.recv‚125722$ disk./.usageGB‚2973.745746612549 disk.sda.out‚12.24267578125 disk.nvme1n1.in‚ 32.453125 disk.nvme1n1.out‚ 749.46875 disk.dm-0.out‚ 1017.9921875( disk./.usagePercent‚83.1471756845729 disk.sdb2.out‚12.24267578125 disk.rbd0.in‚0( proc.memory.availableMB‚ 7530.2421875 disk.sda.in‚0 disk.sda1.out‚0 disk.sdb.in‚0†R„ŸÖ‚(:” ƒˆèÔ©õª gpu.0.gpu‚84.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚230.204' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚57.550999999999995 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ß$>Ööׂ(:ë ƒˆèÔ« cpu‚24.08761533072505 network.sent‚202131 disk.rbd0.in‚0 disk.rbd2.out‚0 disk.nvme0n1.in‚0 disk.sda.out‚ 14.3095703125 disk.nvme1n1.in‚ 32.453125 disk.sdb1.in‚0 disk.sda1.out‚0 disk.nvme1n1.out‚ 891.2890625 disk.sdb.in‚0 disk.sda2.out‚ 14.3095703125$ memory_percent‚54.04033660888672& proc.memory.availableMB‚ 7530.03125 proc.cpu.threads‚17) disk./.usagePercent‚83.14939294371464 disk.md0p1.in‚0 disk.dm-0.out‚ 1160.3046875 disk.rbd2.in‚0" proc.memory.rssMB‚ 2994.3984375 network.recv‚131075 disk.rbd0.out‚0 disk.nvme0n1.out‚ 269.015625 disk.sdb.out‚ 14.3095703125 disk.md0.in‚0 disk.sda.in‚0 disk.sdb2.in‚0 disk.sda2.in‚0% disk./.usageGB‚2973.8250465393066 disk.dm-0.in‚ 32.453125 disk.sdb2.out‚ 14.3095703125 disk.md0.out‚13.8125* proc.memory.percent‚18.276357650756836 disk.md0p1.out‚13.8125 disk.sdb1.out‚0 disk.sda1.in‚0 ‚‹”Ø‚(:‰ ’ˆèÔ§Š˜« gpu.0.gpu‚31.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0hÅõæöÙ‚(:ë ’ˆèÔþ‚°¬ disk.nvme1n1.in‚ 32.453125 disk.md0p1.out‚15.21875 disk.rbd2.out‚0 proc.memory.rssMB‚ 2994.40625* proc.memory.percent‚18.276405334472656) disk./.usagePercent‚83.14799739731235$ disk./.usageGB‚2973.775135040283 disk.sda.out‚15.76708984375 disk.md0.out‚15.21875 disk.sda1.in‚0 disk.nvme0n1.in‚0 disk.nvme0n1.out‚269.0625 disk.sdb.out‚15.76708984375 disk.sdb2.out‚15.76708984375 disk.rbd0.in‚0 disk.rbd0.out‚0 cpu‚24.21971928681417 network.sent‚209778 disk.sda2.out‚15.76708984375$ proc.memory.availableMB‚7530.125 proc.cpu.threads‚17 disk.sdb1.in‚0 disk.sda.in‚0 disk.nvme1n1.out‚ 891.9765625 disk.dm-0.out‚ 1161.0390625 disk.sda1.out‚0 disk.sda2.in‚0 disk.md0.in‚0 disk.md0p1.in‚0 disk.sdb.in‚0 disk.dm-0.in‚ 32.453125% memory_percent‚54.039764404296875 network.recv‚135133 disk.sdb1.out‚0 disk.sdb2.in‚0 disk.rbd2.in‚0 o4”Ú‚(:‰ ¡ˆèÔš¿üª gpu.0.gpu‚84.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚203.418' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚50.8545 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0;†NþÛ‚(:ó ¡ˆèÔ§áÏ« disk.dm-0.out‚ 1244.41015625 disk.rbd2.out‚0 disk.nvme1n1.in‚ 32.453125 disk.md0p1.out‚ 16.82421875$ memory_percent‚54.04000282287598 disk.sdb1.in‚0 disk.sda.in‚0 disk.nvme0n1.in‚0 disk.sdb2.in‚0 proc.memory.rssMB‚ 2994.40625 cpu‚24.328339727124124 network.recv‚140798 disk.dm-0.in‚ 32.453125 disk.sda1.out‚0 disk.sda2.in‚0 disk.md0.in‚0 disk.md0p1.in‚0( proc.memory.availableMB‚ 7530.0859375 proc.cpu.threads‚17 disk.sdb1.out‚0 disk.sdb2.out‚ 17.439453125 disk.md0.out‚ 16.82421875 network.sent‚217010 disk.rbd2.in‚0 disk.sda1.in‚0 disk.nvme1n1.out‚ 975.1953125 disk.sdb.in‚0% disk./.usageGB‚2973.8560943603516! disk.nvme0n1.out‚ 269.21484375 disk.sda2.out‚ 17.439453125 disk.sda.out‚ 17.439453125 disk.sdb.out‚ 17.439453125 disk.rbd0.out‚0* proc.memory.percent‚18.276405334472656) disk./.usagePercent‚83.15026105378558 disk.rbd0.in‚0˜‚0Ü+ _wandbruntime‚155  _runtime‚1550«#ÞÃݽ & lr-AdamW/pg1‚0.0002950959172727613 & lr-AdamW/pg2‚0.0002950959172727613 trainer/global_step‚149 % _timestamp‚1.7884785038344939e+09 _runtime‚ 155.944780224 _step‚8І?ËÇÞÁ & lr-AdamW/pg2‚0.0002950959172727613 trainer/global_step‚149 % _timestamp‚1.7884785038344939e+09 _runtime‚ 155.944780224 _step‚8 & lr-AdamW/pg1‚0.0002950959172727613­90ß+ _wandbruntime‚155  _runtime‚155kî½'à·O TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚20114666097664 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚2626990 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚498 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚17180711902208 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚27139 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚19954629055488 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚19954646094848 D8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚5883770 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚753825 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 174322253824 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 160037042176 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚2626988 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚19954646094848 HDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚20114666097664 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚1616135 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚17355182477312 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚20115465951232 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚19954629055488 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 173224960 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 160819856384 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚19799163751536 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 L@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚5905750 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 159494917688 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 160819856384 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚2369462 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚2369960 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 RGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚753330 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 148321280|ÈûÁ'á»O _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚19954646094848 D8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚5883770 VKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚753825 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 174322253824 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 160037042176 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚2626988 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚19954646094848 HDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚20114666097664 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚1616135 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚17355182477312 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚20115465951232 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚19954629055488 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 173224960 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 160819856384 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚19799163751536 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 L@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚5905750 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 159494917688 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 160819856384 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚2369462 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚2369960 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 RGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚753330 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 148321280 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚20114666097664 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚2626990 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚498 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚17180711902208 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚27139 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚19954629055488 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 ›EäŠ0â+ _wandbruntime‚156  _runtime‚156‡x3 ãÂM ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚20087397406720 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 160557663014 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚2644442 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚5944916 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚2644440 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162988032 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚2644440 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚527 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚1626892 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E=DeviceStatsMonitor.on_train_batch_enÀÿg|•d/segment.small_pool.peak‚475 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚3278470 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 161103380992 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚17470289741312 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚5944916 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚20249283615232 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚20087397406720 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚2385589 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 161886208512 J>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚2385062 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚17294830801408 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 175458939904 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚1626895 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚5922910 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚3278470 PEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚758170 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚524 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚2644442 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚3300474 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚758694 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚17294855705088 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚19769537559328 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 161886208512 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚20087380367360 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 trainer/global_step‚149 % _timestamp‚1.7884785046842337e+09 _runtime‚ 156.795236142 _step‚10 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚984 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚20248483748352 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚17470477633024 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚19769520519968 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 F:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚5922910 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 161339138782 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚20249283615232 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚19930078182982ˆÒ]QÌ&äÆM R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚19930078182982 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚20087397406720 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 160557663014 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚2644442 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚5944916 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚2644440 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162988032 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚2644440 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚527 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚1626892 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚3278470 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 161103380992 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚17470289741312 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚5944916 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚20249283615232 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚20087397406720 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚2385589 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 161886208512 J>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚2385062 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚17294830801408 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 175458939904 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚1626895 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚5922910 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚3278470 PEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚758170 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚524 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚2644442 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚3300474 TIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚758694 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚17294855705088 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚19769537559328 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 161886208512 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚20087380367360 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 trainer/global_step‚149 % _timestamp‚1.7884785046842337e+09 _runtime‚ 156.795236142 _step‚10 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚984 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚20248483748352 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚17470477633024 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚19769520519968 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 F:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚5922910 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 161339138782 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚20249283615232 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ásúO0å+ _wandbruntime‚156  _runtime‚156=­yOæÉ 1loss/SRqqt3/detection_loss‚2.8182724394867336 _runtime‚ 156.796770579 1loss/SRqqt2/assignment_loss‚3.353737963570489 /loss/FRt2/detection_loss‚3.0204968982272677 &loss/total_loss‚101.88958980384162 /loss/FRt4/assignment_loss‚7.322424700919618 .loss/FRt1/detection_loss‚4.370449953983737 .loss/FRt3/detection_loss‚2.630959860499828 .loss/FRt4/detection_loss‚3.447230065756656 1loss/SRqqt4/detection_loss‚2.6354956043152407 .loss/FBt3/detection_loss‚5.135861425172715 /loss/FBt4/detection_loss‚1.8680814777023667 1loss/SRqqt1/assignment_loss‚5.333454392173073 0loss/FBt2/assignment_loss‚0.5962258781667819 1loss/SRqqt2/detection_loss‚2.2629858017519666 /loss/FRt1/assignment_loss‚7.199118247930555 0loss/FBt4/assignment_loss‚0.7288699740429923 .loss/FBt1/detection_loss‚5.746980053073955 .loss/FBt2/detection_loss‚6.521220435698827 1loss/SRqqt4/assignment_loss‚3.241182037762233 1loss/FBt1/assignment_loss‚0.44513329591077394 0loss/FBt3/assignment_loss‚0.2421749128783602 1loss/SRqqt1/detection_loss‚15.091831117868423 trainer/global_step‚149 $ _timestamp‚1.788478504686734e+09 /loss/FRt2/assignment_loss‚7.167876844052915 2loss/SRqqt3/assignment_loss‚3.4111843603151337 epoch‚0 _step‚11 .loss/FRt3/assignment_loss‚7.29834206258097Éá§SçÍ /loss/FRt2/assignment_loss‚7.167876844052915 2loss/SRqqt3/assignment_loss‚3.4111843603151337 epoch‚0 _step‚11 .loss/FRt3/assignment_loss‚7.29834206258097 1loss/SRqqt3/detection_loss‚2.8182724394867336 _runtime‚ 156.796770579 1loss/SRqqt2/assignment_loss‚3.353737963570489 /loss/FRt2/detection_loss‚3.0204968982272677 &loss/total_loss‚101.88958980384162 /loss/FRt4/assignment_loss‚7.322424700919618 .loss/FRt1/detection_loss‚4.370449953983737 .loss/FRt3/detection_loss‚2.630959860499828 .loss/FRt4/detection_loss‚3.447230065756656 1loss/SRqqt4/detection_loss‚2.6354956043152407 .loss/FBt3/detection_loss‚5.135861425172715 /loss/FBt4/detection_loss‚1.8680814777023667 1loss/SRqqt1/assignment_loss‚5.333454392173073 0loss/FBt2/assignment_loss‚0.5962258781667819 1loss/SRqqt2/detection_loss‚2.2629858017519666 /loss/FRt1/assignment_loss‚7.199118247930555 0loss/FBt4/assignment_loss‚0.7288699740429923 .loss/FBt1/detection_loss‚5.746980053073955 .loss/FBt2/detection_loss‚6.521220435698827 1loss/SRqqt4/assignment_loss‚3.241182037762233 1loss/FBt1/assignment_loss‚0.44513329591077394 0loss/FBt3/assignment_loss‚0.2421749128783602 1loss/SRqqt1/detection_loss‚15.091831117868423 trainer/global_step‚149 $ _timestamp‚1.788478504686734e+09 @u€¾”è‚(:‰ °ˆèÔýƇª gpu.0.gpu‚74.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚219.242' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.8105 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÁȽÑé‚(:ü °ˆèÔÎñܪ disk.nvme0n1.in‚0 disk.nvme1n1.in‚ 32.453125 disk.sdb2.in‚0 disk.sda2.out‚19.38427734375( proc.memory.availableMB‚ 7529.7734375 proc.cpu.threads‚17 disk.rbd2.out‚0 disk.sdb1.out‚0 network.sent‚220460 disk.md0p1.out‚ 18.70703125 disk.sda1.in‚0! disk.nvme0n1.out‚ 269.26171875 disk.sdb.out‚19.38427734375 disk.sdb2.out‚19.38427734375 disk.dm-0.out‚ 1347.85546875 disk.sda.out‚19.38427734375 disk.sda1.out‚0 disk.nvme1n1.out‚ 1078.59375 disk.sda2.in‚0$ memory_percent‚54.04191017150879 cpu‚24.424542647576196$ disk./.usageGB‚2974.014762878418 disk.md0p1.in‚0 disk.rbd0.in‚0 disk.rbd0.out‚0 disk.dm-0.in‚ 32.453125 disk.md0.in‚0 disk.md0.out‚ 18.70703125 network.recv‚145033 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda.in‚0 disk.sdb.in‚0# proc.memory.rssMB‚ 2994.41015625* proc.memory.percent‚18.276429176330566) disk./.usagePercent‚83.15469749195866ž¥gߟê‚(:” ¿ˆèÔÿ˜˜« gpu.0.gpu‚68.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0:z~Dë‚(:ø ¿ˆèÔ†˜ï« disk.sdb.in‚0 disk.dm-0.out‚ 1530.015625$ disk./.usageGB‚2974.233455657959 disk.md0p1.in‚0 network.sent‚270524 disk.rbd0.out‚0 disk.sda.in‚0 disk.sda1.out‚0$ memory_percent‚54.04388904571533 proc.cpu.threads‚17 disk.rbd2.out‚0! disk.nvme1n1.out‚ 1260.6015625 disk.sdb2.out‚21.07568359375 cpu‚24.5034575742932 disk.sda1.in‚0 disk.sdb.out‚21.07568359375* proc.memory.percent‚18.276476860046387 disk.nvme0n1.out‚ 269.4140625 disk.dm-0.in‚ 32.453125 disk.sda2.out‚21.07568359375 disk.md0.in‚0 disk.md0p1.out‚ 20.3359375 disk.sda.out‚21.07568359375 disk.md0.out‚ 20.3359375 disk.nvme1n1.in‚ 32.453125 disk.sdb2.in‚0 network.recv‚151098 disk.sda2.in‚0 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sdb1.in‚0) proc.memory.availableMB‚ 7529.44921875) disk./.usagePercent‚83.16081223360466 disk.sdb1.out‚0 disk.nvme0n1.in‚0# proc.memory.rssMB‚ 2994.41796875CÜtÞì‚(:ø ΈèÔÉõ¨« disk.rbd2.in‚0 disk.sdb1.out‚0 disk.md0.in‚0 disk.md0p1.out‚ 21.76953125 disk.dm-0.in‚ 32.453125 disk.nvme0n1.in‚0 disk.md0p1.in‚0 disk.rbd2.out‚0 disk.sdb2.in‚0 disk.sda2.out‚ 22.5810546875* proc.memory.percent‚18.276476860046387 network.recv‚155106) disk./.usagePercent‚83.17132586891643 disk.rbd0.in‚0 disk.sda.in‚0 disk.nvme1n1.in‚ 32.453125# proc.memory.rssMB‚ 2994.41796875 network.sent‚278119 disk.rbd0.out‚0 disk.dm-0.out‚ 1607.8359375 disk.sda1.out‚0 disk.sdb.in‚0 disk.sdb.out‚ 22.5810546875 disk.md0.out‚ 21.76953125) proc.memory.availableMB‚ 7532.72265625$ disk./.usageGB‚2974.609474182129! disk.nvme1n1.out‚ 1338.3828125 disk.sda.out‚ 22.5810546875 disk.sda1.in‚0 cpu‚24.578993914340447 proc.cpu.threads‚17 disk.sdb1.in‚0 disk.nvme0n1.out‚ 269.453125 disk.sdb2.out‚ 22.5810546875 disk.sda2.in‚0$ memory_percent‚54.02390956878662ã²Ü²ží‚(:“ ΈèÔõÿë gpu.0.gpu‚77.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚229.864' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚57.46600000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0nΨ%•î‚(:Š ݈èÔ±˜õ© gpu.0.gpu‚64.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚123.435' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.85875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¡wJ5ï‚(:õ ݈èÔ½éË« disk.sda2.in‚0 disk.md0p1.out‚ 23.66796875 disk.dm-0.out‚ 1839.31640625 disk.sdb1.out‚0 disk.sda.in‚0! proc.memory.rssMB‚ 2994.421875 proc.cpu.threads‚17( disk./.usagePercent‚83.1782620033203 disk.rbd0.out‚0 disk.sda1.in‚0 disk.sdb.in‚0 disk.sdb2.out‚ 24.5224609375 disk.md0p1.in‚0 disk.dm-0.in‚ 32.453125 disk.sda.out‚ 24.5224609375 disk.nvme0n1.in‚0 disk.md0.out‚ 23.66796875$ memory_percent‚54.02369499206543% disk./.usageGB‚2974.8575439453125 disk.rbd2.in‚0 disk.md0.in‚0* proc.memory.percent‚18.276500701904297 disk.rbd2.out‚0! disk.nvme0n1.out‚ 269.84765625 disk.sdb2.in‚0( proc.memory.availableMB‚ 7532.7578125 cpu‚24.64212107581599 network.recv‚160958 disk.rbd0.in‚0 disk.nvme1n1.out‚ 1569.46875 disk.sda2.out‚ 24.5224609375 disk.sdb1.in‚0 disk.sda1.out‚0 network.sent‚285388 disk.nvme1n1.in‚ 32.453125 disk.sdb.out‚ 24.5224609375…FU^0ð+ _wandbruntime‚210  _runtime‚210©l¢ðÆñÀ % _timestamp‚1.7884785587954462e+09 _runtime‚ 210.905756232 _step‚12 ' lr-AdamW/pg1‚0.00039412139286764764 ' lr-AdamW/pg2‚0.00039412139286764764 trainer/global_step‚199(½g¿ÊòÄ trainer/global_step‚199 % _timestamp‚1.7884785587954462e+09 _runtime‚ 210.905756232 _step‚12 ' lr-AdamW/pg1‚0.00039412139286764764 ' lr-AdamW/pg2‚0.00039412139286764764 *[Þå0ó+ _wandbruntime‚210  _runtime‚210K¢Ž¨ìôºO XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚26806376313856 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚22887877142528 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚26805576460288 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚26592194649088 SGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚3499590 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚3499588 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚3158214 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚505 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚3157709 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 213381811200 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 214164625408 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚4366512 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚27139 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 214164625408 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚26592211688448 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 213381811200 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚4366512 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚26805576460288 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚26384838241844 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 HDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚26592211688448 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 D8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚7844122 K?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚3499588 QIDeviceStatsMonitor.on_train_batch_start/inactive_Ja'þÔ split.small_pool.current‚502 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚26384039726924 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 232226082304 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚993 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1736 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚2154132 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚4344534 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚1004079 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚26171397410288 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚26171380370928 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚ 210.907004897 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚26592194649088 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 232067275264 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 _step‚13 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚3499590 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚4344534 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360`˜©Ä'õ¾O TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚27139 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 214164625408 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚26592211688448 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 213381811200 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚4366512 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚26805576460288 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚26384838241844 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 HDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚26592211688448 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 D8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚7844122 K?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚3499588 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚502 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚26384039726924 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 232226082304 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚993 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1736 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚2154132 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚4344534 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚1004079 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚26171397410288 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚26171380370928 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚ 210.907004897 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚26592194649088 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 232067275264 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 _step‚13 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚3499590 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚4344534 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚26806376313856 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚22887877142528 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚26805576460288 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚26592194649088 SGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚3499590 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚3499588 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚3158214 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚505 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚3157709 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 213381811200 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 214164625408 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚4366512 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 TË×R0ö+ _wandbruntime‚211  _runtime‚211¶Ê&÷ÄM EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚26939394110976 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185794560 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚26302047611328 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1736 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚26515752673290 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 215230977536 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚23002045849088 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚1009011 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 233212545536 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚2164892 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 214503577090 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 trainer/global_step‚199 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚4366222 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚23002020945408 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚2164895 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚3517042 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚7905268 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚26516551188418 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 213722101322 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚3173404 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160890880 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _runtime‚ 211.759284436 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚3173906 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚502 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚7883262 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 % _timestamp‚1.7884785596485114e+09 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚4366222 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚26940193977856 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 214448150016 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 233373436416 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚26724945960960 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚4388226 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ODeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚26724963000320 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚1008512 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚7905268 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚3517040At{GK%øÈM SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚3517042 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚4388226 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚3517040 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚26724963000320 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚1008512 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚7905268 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚3517040 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚26939394110976 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185794560 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚26302047611328 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1736 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚26515752673290 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 215230977536 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚23002045849088 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚1009011 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 233212545536 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚2164892 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 214503577090 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 trainer/global_step‚199 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚4366222 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚23002020945408 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚2164895 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚3517042 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚7905268 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚26516551188418 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 213722101322 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚3173404 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160890880 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _runtime‚ 211.759284436 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚3173906 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚502 B6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚7883262 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 % _timestamp‚1.7884785596485114e+09 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚4366222 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚26940193977856 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 214448150016 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 233373436416 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚26724945960960 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚4388226 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 @o‡ã#ƒ:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ODeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚33496486822912 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚2692135 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚1253985 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚28884965314048 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚519 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 _runtime‚ 264.317705275 L@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚9826454 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 265823794304 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 HDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚33229777282048 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚5432286 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 266726580224 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚5454264 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚32970512732152 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚4372188 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚4372190 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 289898027520 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚33229777282048 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚1253469 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚5432286 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 290046348800 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 % _timestamp‚1.7884786122072241e+09 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚33229760242688 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚3945601 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚5454264 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 266605269864 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚28885138539008 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚32703890422928 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚33497286676480 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚33229777282048 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚5432286 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 266726580224 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚5454264 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚32970512732152 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚4372188 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚4372190 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 289898027520 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚33229777282048 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚1253469 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚5432286 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 290046348800 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 % _timestamp‚1.7884786122072241e+09 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚33229760242688 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚3945601 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚5454264 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 266605269864 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚28885138539008 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚32703890422928 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚33497286676480 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚33496486822912 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚2692135 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚1253985 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚28884965314048 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309¶œ«Û0ˆ+ _wandbruntime‚265  _runtime‚265¦CƉÄM KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚9865620 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚3961437 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚1259080 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚32834540623968 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚9865620 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1736 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 291197079552 % _timestamp‚1.7884786130864065e+09 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 267792919040 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚33631104340480 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚5453974 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 bODeY€°ªviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚28709235993088 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚33631104340480 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚33362511554560 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 291027800064 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 267792919040 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚4389640 ODeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚29000433072640 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚2702895 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚29000238889472 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 247988224007«Î&ŠÈM YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚32834540623968 J>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚9865620 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1736 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 291197079552 % _timestamp‚1.7884786130864065e+09 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 267792919040 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚33631104340480 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚5453974 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚28709235993088 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚33631104340480 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚33362511554560 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 291027800064 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 267792919040 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚4389640 ODeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚29000433072640 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚2702895 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚29000238889472 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 F:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚9865620 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚3961437 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚1259080 `0‹+ _wandbruntime‚265  _runtime‚265+¼"lQŒË 2loss/SRqqt3/assignment_loss‚3.3840844362974165 /loss/FRt4/detection_loss‚2.8768519775735006 /loss/FRt4/assignment_loss‚6.985048369125083 /loss/FRt1/detection_loss‚2.0754549196880796 .loss/FRt3/detection_loss‚2.797945389300585 0loss/SRqqt1/detection_loss‚2.310947378055524 1loss/SRqqt2/detection_loss‚3.5953872937709095 0loss/SRqqt4/detection_loss‚2.637001551902638 0loss/FBt2/assignment_loss‚0.5569549407483538 0loss/FBt3/assignment_loss‚0.5895661177853141 .loss/FRt2/detection_loss‚2.640592084612165 %loss/total_loss‚80.30861882158436 0loss/FBt4/assignment_loss‚0.7559984458523962 /loss/FBt1/detection_loss‚3.4964023675355644 /loss/FBt3/detection_loss‚1.3807031288167344 -loss/FBt4/detection_loss‚6.66081912671366 _step‚19 .loss/FRt3/assignment_loss‚6.49915494441986 2loss/SRqqt1/assignment_loss‚2.5101063817234364 2loss/SRqqt4/assignment_loss‚3.2914533821436076 1loss/SRqqt3/detection_loss‚1.7907570515338058 epoch‚0 .loss/FBt2/detection_loss‚5.986719244235271 % _timestamp‚1.7884786130881894e+09 /loss/FRt1/assignment_loss‚7.110238717949909 0loss/FRt2/assignment_loss‚6.9697366714477536 2loss/SRqqt2/assignment_loss‚3.2093600630760193 0loss/FBt1/assignment_loss‚0.1973348372767608 _runtime‚ 265.198242343 trainer/global_step‚249é˜_¿UÏ .loss/FBt2/detection_loss‚5.986719244235271 % _timestamp‚1.7884786130881894e+09 /loss/FRt1/assignment_loss‚7.110238717949909 0loss/FRt2/assignment_loss‚6.9697366714477536 2loss/SRqqt2/assignment_loss‚3.2093600630760193 0loss/FBt1/assignment_loss‚0.1973348372767608 _runtime‚ 265.198242343 trainer/global_step‚249 2loss/SRqqt3/assignment_loss‚3.3840844362974165 /loss/FRt4/detection_loss‚2.8768519775735006 /loss/FRt4/assignment_loss‚6.985048369125083 /loss/FRt1/detection_loss‚2.0754549196880796 .loss/FRt3/detection_loss‚2.797945389300585 0loss/SRqqt1/detection_loss‚2.310947378055524 1loss/SRqqt2/detection_loss‚3.5953872937709095 0loss/SRqqt4/detection_loss‚2.637001551902638 0loss/FBt2/assignment_loss‚0.5569549407483538 0loss/FBt3/assignment_loss‚0.5895661177853141 .loss/FRt2/detection_loss‚2.640592084612165 %loss/total_loss‚80.30861882158436 0loss/FBt4/assignment_loss‚0.7559984458523962 /loss/FBt1/detection_loss‚3.4964023675355644 /loss/FBt3/detection_loss‚1.3807031288167344 -loss/FBt4/detection_loss‚6.66081912671366 _step‚19 .loss/FRt3/assignment_loss‚6.49915494441986 2loss/SRqqt1/assignment_loss‚2.5101063817234364 2loss/SRqqt4/assignment_loss‚3.2914533821436076 1loss/SRqqt3/detection_loss‚1.7907570515338058 epoch‚0“K”Ž‚(:‰ ™‰èÔ¤»í« gpu.0.gpu‚68.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚134.298' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚33.5745 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Áëé(‚(:ö ™‰èÔ—Ú«­) disk./.usagePercent‚83.19221576077459 disk.dm-0.out‚ 2632.87109375 disk.nvme1n1.in‚ 32.453125! disk.nvme1n1.out‚ 2362.7265625 disk.sda2.in‚0 disk.md0.out‚ 30.0703125$ memory_percent‚54.02231216430664 disk.rbd2.in‚0 disk.nvme0n1.in‚0 disk.sdb2.in‚0 disk.sda2.out‚ 31.1396484375 disk.rbd0.in‚0* proc.memory.percent‚18.276500701904297 cpu‚24.828607505307026 disk.dm-0.in‚ 32.453125 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.in‚0 disk.md0p1.out‚ 30.0703125' proc.memory.availableMB‚ 7532.984375 network.recv‚180118% disk./.usageGB‚2975.3565979003906 disk.sda.out‚ 31.1396484375 disk.md0.in‚0 network.sent‚351322 disk.sda.in‚0 disk.sdb.out‚ 31.1396484375 disk.md0p1.in‚0 disk.rbd0.out‚0 disk.rbd2.out‚0! disk.nvme0n1.out‚ 270.14453125! proc.memory.rssMB‚ 2994.421875 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sdb2.out‚ 31.1396484375 proc.cpu.threads‚17ýâg“‚(:ˆ ¨‰èÔ÷óð© gpu.0.gpu‚62.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚205.316' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.329 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0âä)6‘‚(:« ¨‰èԾυ« network.sent‚399706 network.recv‚184680 disk.sdb2.in‚ 8.79296875 disk.sdb2.out‚ 32.642578125 disk.rbd2.out‚0* proc.memory.percent‚18.276500701904297 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.453125 disk.md0.out‚ 31.51171875 disk.rbd0.out‚0 disk.sda2.out‚ 32.642578125 disk.rbd0.in‚0 disk.dm-0.out‚ 2811.3671875 disk.sda.in‚ 53.66015625 disk.sda.out‚ 32.642578125 disk.nvme0n1.in‚0! disk.nvme0n1.out‚ 270.19140625 disk.md0p1.in‚ 62.453125 disk.dm-0.in‚ 32.453125$ memory_percent‚54.02257442474365$ disk./.usageGB‚2974.829055786133 disk.sda1.out‚0 disk.sdb.out‚ 32.642578125 disk.md0p1.out‚ 31.51171875 cpu‚24.858760538817986) disk./.usagePercent‚83.17746546246642 disk.sdb.in‚ 8.79296875 disk.sda2.in‚ 53.66015625) proc.memory.availableMB‚ 7532.94140625! proc.memory.rssMB‚ 2994.421875 disk.sda1.in‚0 disk.rbd2.in‚0 proc.cpu.threads‚17" disk.nvme1n1.out‚ 2541.17578125 disk.md0.in‚ 62.4531256z…’’‚(:‡ ·‰èÔñÊç© gpu.0.gpu‚25.0 gpu.0.memory‚7, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚155.684' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚38.921 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ˆvj <“‚(:± ·‰èÔÊÖùª network.recv‚189567$ disk./.usageGB‚2974.828987121582 disk.nvme1n1.in‚ 32.453125 disk.dm-0.out‚ 2955.66796875) proc.memory.availableMB‚ 7532.57421875* proc.memory.percent‚18.276500701904297 disk.nvme0n1.in‚0 disk.sdb2.in‚ 8.79296875 disk.dm-0.in‚ 32.453125$ memory_percent‚54.02481555938721 cpu‚24.891832312423908) disk./.usagePercent‚83.17746354257683 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda1.out‚0 disk.sdb.out‚34.77587890625 disk.rbd0.in‚0 disk.rbd0.out‚0! proc.memory.rssMB‚ 2994.421875 network.sent‚406557 disk.sda.out‚34.77587890625 disk.sda1.in‚0 disk.md0p1.out‚ 33.6015625 disk.sda.in‚ 53.66015625! disk.nvme0n1.out‚ 270.31640625 disk.sdb.in‚ 8.79296875 disk.sda2.in‚ 53.66015625 disk.sdb1.in‚0 disk.sdb2.out‚34.77587890625 disk.md0.in‚ 62.453125 disk.md0.out‚ 33.6015625! disk.nvme1n1.out‚ 2685.3515625 disk.sda2.out‚34.77587890625 disk.md0p1.in‚ 62.453125 disk.rbd2.out‚0 proc.cpu.threads‚17`dJ“”‚(:ˆ ƉèÔÍÖ« gpu.0.gpu‚57.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚147.606' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚36.9015 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Yöº@•‚(:µ ƉèÔ›ïË« disk.sdb1.out‚0 disk.nvme0n1.in‚0 disk.md0.in‚ 62.48046875! proc.memory.rssMB‚ 2994.421875 proc.cpu.threads‚17) disk./.usagePercent‚83.17606852947722 disk.rbd2.in‚0! disk.nvme0n1.out‚ 270.37890625 disk.sdb.in‚ 8.8046875 disk.sda2.in‚ 53.67578125 disk.md0p1.out‚ 35.41015625 network.sent‚414065 disk.rbd2.out‚0 disk.sda1.out‚0 disk.sdb.out‚36.64794921875 disk.sdb2.in‚ 8.8046875) proc.memory.availableMB‚ 7533.08984375 disk.sda.out‚36.64794921875 disk.rbd0.out‚0% memory_percent‚54.021668434143066 disk.dm-0.out‚ 3100.37109375 disk.sdb1.in‚0! disk.nvme1n1.out‚ 2829.9921875 disk.sdb2.out‚36.64794921875 disk.sda2.out‚36.64794921875 disk.md0p1.in‚ 62.48046875* proc.memory.percent‚18.276500701904297 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.453125 disk.md0.out‚ 35.41015625 disk.rbd0.in‚0 network.recv‚193778$ disk./.usageGB‚2974.779094696045 disk.dm-0.in‚ 32.453125 disk.sda.in‚ 53.67578125 cpu‚24.91912259198515×áºQ0–+ _wandbruntime‚320  _runtime‚320f0æ ×½ & lr-AdamW/pg2‚0.0005921723440574203 trainer/global_step‚299 % _timestamp‚1.7884786681865897e+09 _runtime‚ 320.29686691 _step‚20 & lr-AdamW/pg1‚0.0005921723440574203§n@¨Ç˜Á & lr-AdamW/pg1‚0.0005921723440574203 & lr-AdamW/pg2‚0.0005921723440574203 trainer/global_step‚299 % _timestamp‚1.7884786681865897e+09 _runtime‚ 320.29686691 _step‚20€Ži0™+ _wandbruntime‚320  _runtime‚320ñZŸ:ñš¾O UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚40188197039104 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 320854163456 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚39236417514288 _step‚21 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚39867325836288 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 trainer/global_step‚299 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚4735458 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 320854163456 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚40187397185536 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚1505323 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚6542016 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 320071349248 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 175322112 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚34302257430528 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚39555388707540 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚6520038 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚6520038 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 Iõ!ÜÈ'›ÂO KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚11764826 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚6542016 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚502 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 320854163456 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚40187397185536 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚1505323 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚6542016 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 320071349248 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 175322112 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚34302257430528 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚39555388707540 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚6520038 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚6520038 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚39867325836288 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 trainer/global_step‚299 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚4735458 IDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚40321214836224 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚34765404065792 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚34416401233408 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884786692062552e+09 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚4750739 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚517 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚5262242 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 320050977938 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚11825972 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚1509847 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 154599424 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚11803966 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 _step‚22 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚6541726 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚6563730 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚39687900169034 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚39367050675968 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚40322014703104 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚4751259 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚3240895 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚5262242 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 348977928704 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 348823329280 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 trainer/global_step‚299 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ODeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200:šÖ`Ò&žÌM FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚11803966 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 _step‚22 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚6541726 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚6563730 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚39687900169034 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚39367050675968 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚40322014703104 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚4751259 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚3240895 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚5262242 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 348977928704 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 348823329280 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 trainer/global_step‚299 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ODeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚6541726 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚40322014703104 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚6563730 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 321137688064 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚40321214836224 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚34765404065792 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚34416401233408 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884786692062552e+09 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚4750739 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚517 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚5262242 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 320050977938 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚11825972 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚1509847 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 154599424 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0Ö e0Ÿ+ _wandbruntime‚321  _runtime‚321_ì4 Ê /loss/FRt2/assignment_loss‚6.305005199030826 /loss/FRt1/detection_loss‚2.0701598928008282 /loss/FRt4/detection_loss‚2.6254694649765082 0loss/SRqqt4/detection_loss‚4.047130223492096 _step‚23 1loss/SRqqt1/assignment_loss‚1.879477608377916 /loss/FBt1/assignment_loss‚0.358705Z¬ùì211921108 /loss/FBt3/detection_loss‚4.5305231127502585 % _timestamp‚1.7884786692088661e+09 0loss/SRqqt3/detection_loss‚2.854102316082165 -loss/FBt4/detection_loss‚4.59080192972632 %loss/total_loss‚79.92207353786415 epoch‚0 0loss/FBt4/assignment_loss‚0.5352535250458191 1loss/SRqqt1/detection_loss‚1.9861402110244235 trainer/global_step‚299 2loss/SRqqt2/assignment_loss‚3.2562804422645923 2loss/SRqqt3/assignment_loss‚3.1276977997954174 0loss/FBt3/assignment_loss‚0.6389175338347834 1loss/SRqqt2/detection_loss‚2.6179759624962493 .loss/FBt1/detection_loss‚2.787687748949975 0loss/FRt4/assignment_loss‚6.5682109712480425 0loss/FBt2/assignment_loss‚0.6926160294309133 .loss/FRt3/detection_loss‚4.367615923285484 _runtime‚ 321.319111329 /loss/FRt1/assignment_loss‚5.250041461326707 /loss/FRt2/detection_loss‚2.9774406489573026 .loss/FBt2/detection_loss‚5.956021225700776 /loss/FRt3/assignment_loss‚7.170697371164958 2loss/SRqqt4/assignment_loss‚2.7281017241806818Ù&P(T¡Î 2loss/SRqqt2/assignment_loss‚3.2562804422645923 2loss/SRqqt3/assignment_loss‚3.1276977997954174 0loss/FBt3/assignment_loss‚0.6389175338347834 1loss/SRqqt2/detection_loss‚2.6179759624962493 .loss/FBt1/detection_loss‚2.787687748949975 0loss/FRt4/assignment_loss‚6.5682109712480425 0loss/FBt2/assignment_loss‚0.6926160294309133 .loss/FRt3/detection_loss‚4.367615923285484 _runtime‚ 321.319111329 /loss/FRt1/assignment_loss‚5.250041461326707 /loss/FRt2/detection_loss‚2.9774406489573026 .loss/FBt2/detection_loss‚5.956021225700776 /loss/FRt3/assignment_loss‚7.170697371164958 2loss/SRqqt4/assignment_loss‚2.7281017241806818 /loss/FRt2/assignment_loss‚6.305005199030826 /loss/FRt1/detection_loss‚2.0701598928008282 /loss/FRt4/detection_loss‚2.6254694649765082 0loss/SRqqt4/detection_loss‚4.047130223492096 _step‚23 1loss/SRqqt1/assignment_loss‚1.879477608377916 /loss/FBt1/assignment_loss‚0.358705211921108 /loss/FBt3/detection_loss‚4.5305231127502585 % _timestamp‚1.7884786692088661e+09 0loss/SRqqt3/detection_loss‚2.854102316082165 -loss/FBt4/detection_loss‚4.59080192972632 %loss/total_loss‚79.92207353786415 epoch‚0 0loss/FBt4/assignment_loss‚0.5352535250458191 1loss/SRqqt1/detection_loss‚1.9861402110244235 trainer/global_step‚299ãéÏ¡“¢‚(:ˆ Õ‰èÔÔñ’« gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚206.943' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.73575 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¿ÏOî5£‚(:ª Õ‰èÔâžž¬) disk./.usagePercent‚83.17823832468217 disk.sda1.out‚0$ memory_percent‚54.02669906616211 network.sent‚431824% disk./.usageGB‚2974.8566970825195 disk.md0.out‚ 37.08984375 disk.sdb1.out‚0 disk.nvme0n1.in‚0 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 37.08984375 disk.rbd0.out‚0 disk.dm-0.out‚ 3321.78125 disk.sda.out‚ 38.392578125 cpu‚24.945544059925446 proc.cpu.threads‚17 network.recv‚198928 disk.sdb2.out‚ 38.392578125 disk.sdb1.in‚0 disk.sda.in‚ 53.67578125! disk.nvme1n1.out‚ 2974.2890625 disk.sda2.out‚ 38.392578125 disk.rbd2.out‚0# proc.memory.rssMB‚ 2994.42578125 disk.sdb.in‚ 8.8046875 disk.sdb.out‚ 38.392578125 disk.sda2.in‚ 53.67578125 disk.rbd0.in‚0 disk.rbd2.in‚0* proc.memory.percent‚18.276524543762207 disk.nvme1n1.in‚ 32.453125 disk.sdb2.in‚ 8.8046875 disk.dm-0.in‚ 32.453125' proc.memory.availableMB‚ 7532.265625 disk.md0.in‚ 62.48046875 disk.sda1.in‚0 disk.nvme0n1.out‚ 347.4921875$ üÜ“¤‚(:ˆ ä‰èÔêÏ’« gpu.0.gpu‚24.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚167.434' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚41.8585 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ä‡50<¥‚(:± ä‰èÔÇ‘Å« disk.nvme0n1.in‚0" proc.memory.rssMB‚ 2994.4296875 cpu‚24.97006985966455 disk.sdb2.in‚ 8.8046875 disk.dm-0.in‚ 32.453125 disk.rbd2.in‚0) disk./.usagePercent‚83.17911123447705 disk.sda.out‚ 40.6494140625 disk.nvme1n1.in‚ 32.453125 disk.sdb.in‚ 8.8046875 disk.sdb.out‚ 40.6494140625 disk.md0p1.out‚ 39.28515625 network.sent‚467652 disk.rbd0.out‚0 disk.rbd2.out‚0( proc.memory.availableMB‚ 7532.2421875 proc.cpu.threads‚17 network.recv‚203809% disk./.usageGB‚2974.8879165649414 disk.sda.in‚ 53.67578125" disk.nvme1n1.out‚ 3102.35546875 disk.sda2.out‚ 40.6494140625 disk.md0p1.in‚ 62.48046875 disk.rbd0.in‚0* proc.memory.percent‚18.276548385620117 disk.sda1.out‚0! disk.nvme0n1.out‚ 378.82421875 disk.md0.in‚ 62.48046875 disk.md0.out‚ 39.28515625 disk.dm-0.out‚ 3481.1796875 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sdb2.out‚ 40.6494140625 disk.sda2.in‚ 53.67578125$ memory_percent‚54.02684211730957 disk.sdb1.in‚0}úÄ€’¦‚(:‡ ó‰èÔÉ·ƒ« gpu.0.gpu‚4.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚116.306' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.0765 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ë“œÉ=§‚(:² ó‰èÔß빫 disk.rbd2.out‚0 disk.sdb1.in‚0 disk.md0.in‚ 62.48046875 disk.sdb.in‚ 8.8046875 disk.sda2.in‚ 53.67578125 disk.rbd2.in‚0 disk.sdb1.out‚0! disk.nvme0n1.out‚ 436.90234375( disk./.usagePercent‚83.1817309238065 disk.sdb.out‚42.40576171875 disk.rbd0.in‚0 disk.dm-0.out‚ 3699.46484375( proc.memory.availableMB‚ 7532.4765625 proc.cpu.threads‚17% disk./.usageGB‚2974.9816093444824 disk.sda2.out‚42.40576171875$ memory_percent‚54.02541160583496 disk.sdb2.in‚ 8.8046875 disk.md0.out‚ 40.97265625 disk.rbd0.out‚0" proc.memory.rssMB‚ 2994.4296875 cpu‚24.992659729949906 disk.nvme1n1.in‚ 32.453125 disk.sda.in‚ 53.67578125 disk.sda.out‚42.40576171875 disk.nvme1n1.out‚ 3262.5625 disk.md0p1.in‚ 62.48046875 disk.sda1.in‚0 network.sent‚476552 network.recv‚208811 disk.sdb2.out‚42.40576171875 disk.sda1.out‚0 disk.nvme0n1.in‚0* proc.memory.percent‚18.276548385620117 disk.md0p1.out‚ 40.97265625 disk.dm-0.in‚ 32.453125Z}Y’¨‚(:‡ ‚Šèԇī gpu.0.gpu‚49.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚204.976' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.244 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0:ùKO<©‚(:± ‚ŠèÔ¿¨­¬ network.sent‚481145) disk./.usagePercent‚83.18522597612305 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.out‚ 44.4248046875 disk.sdb2.in‚ 8.8046875 disk.dm-0.in‚ 32.453125& proc.memory.availableMB‚ 7532.84375 network.recv‚211942 disk.nvme0n1.in‚0 disk.md0.out‚ 42.92578125 disk.sda.in‚ 53.67578125 disk.sda.out‚ 44.4248046875 disk.rbd2.out‚0% memory_percent‚54.023170471191406% disk./.usageGB‚2975.1066093444824 disk.nvme1n1.in‚ 32.453125! disk.nvme1n1.out‚ 3394.7109375 disk.sdb2.out‚ 44.4248046875 disk.sda2.out‚ 44.4248046875 disk.md0.in‚ 62.48046875 disk.md0p1.out‚ 42.92578125 disk.rbd0.out‚0 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sdb.in‚ 8.8046875 disk.md0p1.in‚ 62.48046875 disk.rbd0.in‚0 disk.dm-0.out‚ 3947.11328125" proc.memory.rssMB‚ 2994.4296875 cpu‚25.015907168860075 proc.cpu.threads‚17! disk.nvme0n1.out‚ 552.40234375 disk.sda2.in‚ 53.67578125* proc.memory.percent‚18.276548385620117z×ìà0ª+ _wandbruntime‚378  _runtime‚378ú½Ä«¾ & lr-AdamW/pg1‚0.0006911978196523067 & lr-AdamW/pg2‚0.0006911978196523067 trainer/global_step‚349 % _timestamp‚1.7884787262174568e+09 _runtime‚ 378.327820272 _step‚24œ_]Ȭ & lr-AdamW/pg1‚0.0006911978196523067 & lr-AdamW/pg2‚0.0006911978196523067 trainer/global_step‚349 % _timestamp‚1.7884787262174568e+09 _runtime‚ 378.327820272 _step‚24áò%0­+ _wandbruntime‚378  _runtime‚378h/'Ä'®¾O LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚45768927566288 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚46878307548160 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 374198932480 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 374198932480 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚40415126248448 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚13725178 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 173224960 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚1756407 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 % _timestamp‚1.7884787262212534e+09 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚46879107401728 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚504 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 373416118272 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 _runtime‚ 378.331686239 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 405678673920 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1741 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚6117390 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚5524542 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 405826995200 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚46504908469248 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚40415299473408 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚13747158 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚46504891429888 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 148321280 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚25 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚46878307548160 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚46504891429888 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 372152670920 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚46141063197848 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚7607790 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚46504908469248 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚501 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚40009447574528 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚1755906 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 373416118272 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 _runtime‚ 378.331686239 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 405678673920 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1741 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚6117390 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚5524542 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 405826995200 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚46504908469248 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚40415299473408 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚13747158 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚46504891429888 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 148321280 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚25 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚46878307548160 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚46504891429888 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 372152670920 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚46141063197848 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚7607790 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚46504908469248 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚501 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚40009447574528 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚1755906 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 I8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 373996892014 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 373215416246 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚6134842 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 KBDeviceStatsMonitor.on_train_vùy˜batch_end/segment.large_pool.allocated‚1309 % _timestamp‚1.7884787271456103e+09 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 375265284608 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚45899577767328 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚46637659781120 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 406849840128 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚6134840 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚40123616281088 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 _runtime‚ 379.256372889 ODeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚5539790 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚5540302 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚3778892 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚7651482 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚46637642741760 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 375265284608 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 173211648 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚6134840 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚47012925065728 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 374482457088 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _step‚26 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚13786324 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚1760898 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚998 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚40530614429184 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200;á§Ò&²ÌM trainer/global_step‚349 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚13786324 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚6134842 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚7651482 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚47012925065728 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚45899560727968 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 374482457088 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1741 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚46637642741760 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚40123591377408 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚46272776144214 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚13764318 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚46637659781120 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚40530441217536 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 373996892014 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 373215416246 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚6134842 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 % _timestamp‚1.7884787271456103e+09 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 375265284608 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚45899577767328 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚46637659781120 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 406849840128 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚6134840 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚40123616281088 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 _runtime‚ 379.256372889 ODeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚5539790 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚5540302 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚3778892 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚7651482 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚46637642741760 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 375265284608 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 173211648 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚6134840 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚47012925065728 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 374482457088 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _step‚26 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚13786324 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚1760898 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚998 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚40530614429184 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚13764318 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚3778895 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200n’õ0³+ _wandbruntime‚379  _runtime‚379D'Q´Ë %loss/total_loss‚71.69093667406563 trainer/global_step‚349 /loss/FRt4/assignment_loss‚6.164311387517431 2loss/SRqqt1/assignment_loss‚1.7946316346305742 1loss/SRqqt3/assignment_loss‚3.360508362452189 0loss/FBt2/assignment_loss‚0.5993647020026805 .loss/FBt1/detection_loss‚2.657670861110091 /loss/FBt2/detection_loss‚4.9566622442669335 .loss/FBt4/detection_loss‚2.956661674711439 /loss/FRt1/assignment_loss‚4.871036192774772 0loss/SRqqt4/assignment_loss‚3.10057403643926 1loss/FBt1/assignment_loss‚0.18750286188528004 .loss/FRt1/detection_loss‚1.815666531957686 /loss/FRt3/detection_loss‚3.6600555573639117 /loss/FRt4/detection_loss‚2.3406713014250404 _runtime‚ 379.257857586 0loss/FRt3/assignment_loss‚6.9599454779373975 /loss/FBt3/detection_loss‚1.8087081570303607 _step‚27 /loss/FRt2/assignment_loss‚6.527761348458224 .loss/FRt2/detection_loss‚2.751938903054526 1loss/SRqqt1/detection_loss‚1.5499747074052188 1loss/SRqqt2/assignment_loss‚3.075168070969758 1loss/SRqqt3/detection_loss‚3.9619276080376062 1loss/FBt4/assignment_loss‚0.41989961428981704 0loss/SRqqt4/detection_loss‚2.584133293766242 0loss/FBt3/assignment_loss‚0.6399529677562392 % _timestamp‚1.7884787271478338e+09 0loss/SRqqt2/detection_loss‚2.946209176822945 epoch‚0> éˆUµÏ .loss/FBt4/detection_loss‚2.956661674711439 /loss/FRt1/assignment_loss‚4.871036192774772 0loss/SRqqt4/assignment_loss‚3.10057403643926 1loss/FBt1/assignment_loss‚0.18750286188528004 .loss/FRt1/detection_loss‚1.815666531957686 /loss/FRt3/detection_loss‚3.6600555573639117 /loss/FRt4/detection_loss‚2.3406713014250404 _runtime‚ 379.257857586 0loss/FRt3/assignment_loss‚6.9599454779373975 /loss/FBt3/detection_loss‚1.8087081570303607 _step‚27 /loss/FRt2/assignment_loss‚6.527761348458224 .loss/FRt2/detection_loss‚2.751938903054526 1loss/SRqqt1/detection_loss‚1.5499747074052188 1loss/SRqqt2/assignment_loss‚3.075168070969758 1loss/SRqqt3/detection_loss‚3.9619276080376062 1loss/FBt4/assignment_loss‚0.41989961428981704 0loss/SRqqt4/detection_loss‚2.584133293766242 0loss/FBt3/assignment_loss‚0.6399529677562392 % _timestamp‚1.7884787271478338e+09 0loss/SRqqt2/detection_loss‚2.946209176822945 epoch‚0 %loss/total_loss‚71.69093667406563 trainer/global_step‚349 /loss/FRt4/assignment_loss‚6.164311387517431 2loss/SRqqt1/assignment_loss‚1.7946316346305742 1loss/SRqqt3/assignment_loss‚3.360508362452189 0loss/FBt2/assignment_loss‚0.5993647020026805 .loss/FBt1/detection_loss‚2.657670861110091 /loss/FBt2/detection_loss‚4.9566622442669335¼ãeД¶‚(:‰ ‘ŠèÔØÞ¢« gpu.0.gpu‚56.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚213.787' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.44675 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÚgŸ,·‚(:¡ ‘ŠèÔ̼֫ disk.sdb2.in‚ 8.8046875 disk.sdb2.out‚ 46.1689453125 disk.rbd2.in‚0 disk.sdb1.in‚0 network.recv‚217227 disk.nvme1n1.out‚ 3406.9375 disk.rbd0.in‚0 disk.rbd0.out‚0 disk.dm-0.in‚ 32.453125 disk.dm-0.out‚ 4017.421875 disk.rbd2.out‚0 network.sent‚485953 disk.sdb.in‚ 8.8046875 disk.sda2.out‚ 46.1689453125# memory_percent‚54.0252685546875 disk.md0.out‚ 44.609375 disk.nvme0n1.out‚ 610.484375* proc.memory.percent‚18.276572227478027 disk.nvme1n1.in‚ 32.453125 disk.sdb1.out‚0# proc.memory.rssMB‚ 2994.43359375 proc.cpu.threads‚17) disk./.usagePercent‚83.19222290703024 disk.md0p1.in‚ 62.48046875 disk.sda1.out‚0 cpu‚25.032435861063064 disk.sda2.in‚ 53.67578125 disk.md0.in‚ 62.48046875 disk.md0p1.out‚ 44.609375 disk.nvme0n1.in‚0" proc.memory.availableMB‚7532.5% disk./.usageGB‚2975.3568534851074 disk.sdb.out‚ 46.1689453125 disk.sda.in‚ 53.67578125 disk.sda.out‚ 46.1689453125 disk.sda1.in‚0V–€­“¸‚(:ˆ  ŠèÔ¾‹æª gpu.0.gpu‚85.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚235.152' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.788 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Õ¤áê4¹‚(:©  ŠèÔÌ»¸«) proc.memory.availableMB‚ 7532.47265625 disk.sda2.in‚ 53.67578125 disk.md0p1.in‚ 62.48046875" disk.nvme1n1.out‚ 3551.01171875 disk.sdb.out‚ 47.783203125$ memory_percent‚54.02543544769287 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda.out‚ 47.783203125 disk.nvme0n1.out‚ 683.4765625 disk.sdb.in‚ 8.8046875 disk.md0.in‚ 62.48046875 proc.cpu.threads‚17 network.sent‚534724 network.recv‚222004) disk./.usagePercent‚83.18716559789969$ disk./.usageGB‚2975.175979614258 disk.md0p1.out‚46.15625 disk.rbd0.in‚0 disk.sda.in‚ 53.67578125 disk.nvme0n1.in‚0 disk.rbd2.in‚0 disk.sda1.in‚0 disk.sdb2.in‚ 8.8046875 disk.sdb2.out‚ 47.783203125 disk.sda2.out‚ 47.783203125# proc.memory.rssMB‚ 2994.43359375 disk.rbd0.out‚0 disk.dm-0.out‚ 4234.48828125 disk.nvme1n1.in‚ 32.453125 cpu‚25.047787648522743 disk.dm-0.in‚ 32.453125 disk.rbd2.out‚0 disk.sda1.out‚0 disk.md0.out‚46.15625* proc.memory.percent‚18.276572227478027€ËÀ–“º‚(:ˆ ¯ŠèÔÖ‰« gpu.0.gpu‚61.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚216.172' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.043 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ƒÏÏÀ?»‚(:´ ¯ŠèÔïä¿«% disk./.usageGB‚2974.2952308654785 disk.nvme0n1.in‚0 disk.md0.in‚ 62.48046875 disk.rbd0.in‚0 disk.nvme0n1.out‚726.375 disk.nvme1n1.in‚ 32.453125 disk.sda.out‚49.39990234375 cpu‚25.063192350641856 disk.rbd0.out‚0 disk.sda.in‚ 53.67578125" disk.nvme1n1.out‚ 3672.76953125 disk.sda2.in‚ 53.67578125 disk.sda2.out‚49.39990234375 disk.md0.out‚ 47.73046875 disk.md0p1.out‚ 47.73046875 disk.dm-0.out‚ 4399.14453125 disk.rbd2.in‚0 disk.sda1.in‚0 disk.sdb2.in‚ 8.8046875 disk.md0p1.in‚ 62.48046875# proc.memory.rssMB‚ 2994.43359375 disk.rbd2.out‚0 disk.sda1.out‚0 network.sent‚543608 network.recv‚226980) disk./.usagePercent‚83.16253949426184 disk.sdb2.out‚49.39990234375 disk.sdb1.in‚0 disk.sdb1.out‚0) proc.memory.availableMB‚ 7532.45703125 disk.sdb.in‚ 8.8046875 disk.sdb.out‚49.39990234375 disk.dm-0.in‚ 32.453125$ memory_percent‚54.02553081512451* proc.memory.percent‚18.276572227478027 proc.cpu.threads‚17÷÷ûW0¼+ _wandbruntime‚428  _runtime‚4282½¼ % lr-AdamW/pg1‚0.000790223295247193 % lr-AdamW/pg2‚0.000790223295247193 trainer/global_step‚399 % _timestamp‚1.7884787767784534e+09 _runtime‚ 428.888766683 _step‚28?¾kLƾÀ % lr-AdamW/pg1‚0.000790223295247193 % lr-AdamW/pg2‚0.000790223295247193 trainer/global_step‚399 % _timestamp‚1.7884787767784534e+09 _runtime‚ 428.888766683 _step‚28Xêpì0¿+ _wandbruntime‚428  _runtime‚428åá*J!À¿O KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 _step‚29 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚8717520 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚4306135 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚27139 SGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚6989990 OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚6989988 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚52301437618288 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚2008249 _runtime‚ 428.890021129 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚6314905 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 425317109228 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 trainer/global_step‚399 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚53570017764352 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚15707510 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚4306132 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160904192 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 427543701504 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚53569217910784 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 426760887296 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 K?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚6989988 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚53569217910784 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚15685530 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚8695542 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚46180358036480 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚52301420578928 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚8717520 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚45716637718528 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚53142474062848 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚6314381 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚53570017764352 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 % _timestamp‚1.7884787767796357e+09 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 426760887296 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚53142457023488 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚8695542 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚46180543844352 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_Ë 0¶bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚2008770 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚6989990 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚53142457023488 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185807872 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚2008249 _runtime‚ 428.890021129 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚6314905 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 425317109228 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 trainer/global_step‚399 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚53570017764352 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚15707510 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚4306132 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160904192 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 427543701504 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚53569217910784 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 426760887296 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 K?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚6989988 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚53569217910784 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚15685530 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚8695542 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚46180358036480 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚52301420578928 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚8717520 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚45716637718528 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚53142474062848 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚6314381 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475çr«A0Â+ _wandbruntime‚429  _runtime‚429ž*Ï&ÃÉM [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚46295833577472 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 J>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚6330082 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚8739234 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚15724670 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 427827226112 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2013728 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚4316892 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 _runtime‚ 429.745988557 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 465027152384 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 trainer/global_step‚399 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚53275208335360 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚6330623 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚4316895 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 426379854554 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 428610053632 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚8717230 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚46295645685760 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚52858450634522 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚7007440 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚15746676 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚52432087819328 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚7007442 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚53703835428352 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 427827226112 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚52859249149650 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚8717230 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚7007442 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚52432070779968 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚53275225374720 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚7007440 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187891712 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 % _timestamp‚1.7884787776346192e+09 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚53703835428352 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚53703035561472 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚538 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 464864164352 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚53275225374720 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚45830806425088 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚2013190 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 _step‚30 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚53275208335360 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚15746676 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2-Äb€Ó&ÄÍM VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚53703835428352 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚53703035561472 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚538 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 464864164352 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚53275225374720 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚45830806425088 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚2013190 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 _step‚30 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚53275208335360 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚15746676 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚46295833577472 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 J>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚6330082 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚8739234 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚15724670 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 427827226112 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2013728 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚4316892 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 _runtime‚ 429.745988557 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 465027152384 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 trainer/global_step‚399 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚53275208335360 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚6330623 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚4316895 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 426379854554 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 428610053632 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚8717230 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚46295645685760 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚52858450634522 I=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚7007440 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚15746676 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚52432087819328 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚7007442 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚53703835428352 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 427827226112 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚52859249149650 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚8717230 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚7007442 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚52432070779968 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚53275225374720 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚7007440 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187891712 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 % _timestamp‚1.7884787776346192e+09Dµ„0Å+ _wandbruntime‚429  _runtime‚429S —ÅNÆÓ _step‚31 /loss/FRt4/assignment_loss‚6.140453665106146 /loss/FRt4/detection_loss‚2.3138438337021046 0loss/FRt2/assignment_loss‚6.1446296168911845 1loss/SRqqt3/assignment_loss‚3.262334395538677 2loss/SRqqt4/assignment_loss‚3.5569689211092497 1loss/SRqqt2/detection_loss‚2.7483843933968317 1loss/SRqqt3/detection_loss‚3.1997787220911547 /loss/FBt2/detection_loss‚3.1638054211934405 1loss/SRqqt2/assignment_loss‚3.463695012387775 /loss/FBt3/detection_loss‚2.1329576157055765 /loss/FBt4/detection_loss‚4.0096328010161715 epoch‚0 trainer/global_step‚399 0loss/FBt1/assignment_loss‚0.4339822639526334 1loss/FBt2/assignment_loss‚0.35478514408217354 0loss/FBt4/assignment_loss‚0.6370221452865129 /loss/FRt2/detection_loss‚2.7972515980082173 1loss/SRqqt1/detection_loss‚[µ« 1.5826038944560128 1loss/SRqqt4/detection_loss‚2.5998821164432324 /loss/FBt1/detection_loss‚1.7780095738114663 %loss/total_loss‚70.01515615097183 1loss/FBt3/assignment_loss‚0.41715329666277334 /loss/FRt3/detection_loss‚3.7127677952089617 _runtime‚ 429.747003561 /loss/FRt1/assignment_loss‚4.609048546929109 /loss/FRt3/assignment_loss‚6.960775098493023 2loss/SRqqt1/assignment_loss‚2.1086875288369686 /loss/FRt1/detection_loss‚1.8867027506624396 % _timestamp‚1.7884787776369872e+09â¶(ˆ]Ç× %loss/total_loss‚70.01515615097183 1loss/FBt3/assignment_loss‚0.41715329666277334 /loss/FRt3/detection_loss‚3.7127677952089617 _runtime‚ 429.747003561 /loss/FRt1/assignment_loss‚4.609048546929109 /loss/FRt3/assignment_loss‚6.960775098493023 2loss/SRqqt1/assignment_loss‚2.1086875288369686 /loss/FRt1/detection_loss‚1.8867027506624396 % _timestamp‚1.7884787776369872e+09 _step‚31 /loss/FRt4/assignment_loss‚6.140453665106146 /loss/FRt4/detection_loss‚2.3138438337021046 0loss/FRt2/assignment_loss‚6.1446296168911845 1loss/SRqqt3/assignment_loss‚3.262334395538677 2loss/SRqqt4/assignment_loss‚3.5569689211092497 1loss/SRqqt2/detection_loss‚2.7483843933968317 1loss/SRqqt3/detection_loss‚3.1997787220911547 /loss/FBt2/detection_loss‚3.1638054211934405 1loss/SRqqt2/assignment_loss‚3.463695012387775 /loss/FBt3/detection_loss‚2.1329576157055765 /loss/FBt4/detection_loss‚4.0096328010161715 epoch‚0 trainer/global_step‚399 0loss/FBt1/assignment_loss‚0.4339822639526334 1loss/FBt2/assignment_loss‚0.35478514408217354 0loss/FBt4/assignment_loss‚0.6370221452865129 /loss/FRt2/detection_loss‚2.7972515980082173 1loss/SRqqt1/detection_loss‚1.5826038944560128 1loss/SRqqt4/detection_loss‚2.5998821164432324 /loss/FBt1/detection_loss‚1.7780095738114663^ñΔȂ(:‰ ¾ŠèÔÀ‰ƒ« gpu.0.gpu‚63.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚122.486' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.6215 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚06t:'É‚(:œ ¾ŠèÔÞÕЫ disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚49.1875 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.nvme0n1.in‚0 disk.sdb2.in‚ 8.8046875) proc.memory.availableMB‚ 7532.60546875* proc.memory.percent‚18.276572227478027) disk./.usagePercent‚83.16253789435385 disk.md0.in‚ 62.48046875 disk.dm-0.out‚ 4514.8125 disk.sda1.out‚0! disk.nvme1n1.out‚ 3672.9453125% disk./.usageGB‚2974.2951736450195 disk.sda.in‚ 53.67578125 disk.sda1.in‚0 proc.cpu.threads‚17 disk.sda.out‚ 50.9140625 network.recv‚231103 disk.sda2.out‚ 50.9140625 disk.md0.out‚49.1875 disk.nvme0n1.out‚ 841.8671875 disk.sdb.in‚ 8.8046875 disk.sdb.out‚ 50.9140625 disk.sda2.in‚ 53.67578125 disk.rbd2.out‚0 disk.sdb2.out‚ 50.9140625% memory_percent‚54.024624824523926 cpu‚25.078138595665486 network.sent‚559912 disk.dm-0.in‚ 32.453125 disk.rbd0.in‚0 disk.rbd0.out‚0 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.453125# proc.memory.rssMB‚ 2994.43359375Â+;4“Ê‚(:ˆ ÍŠèÔð«Ú« gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0h·EÔ$Ë‚(:™ ÍŠèÔœ•ö« disk.sdb1.out‚0 disk.sda.in‚ 53.67578125 disk.sda2.out‚ 52.828125 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 51.046875 disk.rbd0.out‚0 disk.sdb.out‚ 52.828125 disk.sdb2.out‚ 52.828125 disk.sda2.in‚ 53.67578125 disk.rbd2.in‚0# proc.memory.rssMB‚ 2994.43359375* proc.memory.percent‚18.276572227478027 disk.sda1.out‚0 disk.nvme0n1.out‚ 928.5859375 network.sent‚597112 network.recv‚237043 disk.md0.in‚ 62.48046875$ memory_percent‚54.02541160583496 disk.nvme0n1.in‚0 disk.sdb1.in‚0 disk.sda.out‚ 52.828125 disk.sdb.in‚ 8.8046875( proc.memory.availableMB‚ 7532.4765625 cpu‚25.09111848895739 disk.sdb2.in‚ 8.8046875 disk.dm-0.out‚ 4601.8046875 disk.nvme1n1.in‚ 32.453125 disk.rbd2.out‚0 disk.sda1.in‚0 disk.nvme1n1.out‚ 3673.21875 disk.md0.out‚ 51.046875 disk.rbd0.in‚0 disk.dm-0.in‚ 32.453125 proc.cpu.threads‚17) disk./.usagePercent‚83.16253853431704$ disk./.usageGB‚2974.295196533203äýÁµŸÌ‚(:” ÜŠèÔ…¦Ñ© gpu.0.gpu‚70.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚122.818' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚30.704500000000003 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ze€O8Í‚(:­ ÜŠèÔ¾†¨¬ disk.sda.out‚54.22900390625 disk.sdb.out‚54.22900390625 disk.sda2.out‚54.22900390625 disk.rbd0.out‚0 disk.rbd2.out‚0 disk.nvme0n1.in‚0 disk.md0.out‚52.40625# proc.memory.rssMB‚ 2994.43359375 disk.sda.in‚ 53.67578125 cpu‚25.10231338245311 network.sent‚604756 network.recv‚241175 disk.sdb1.in‚0 disk.sdb1.out‚0" disk.nvme1n1.out‚ 3673.30078125 disk.md0p1.out‚52.40625 disk.sda1.in‚0 disk.sdb2.in‚ 8.8046875 disk.sdb2.out‚54.22900390625 disk.sda2.in‚ 53.67578125 disk.md0p1.in‚ 62.48046875 proc.cpu.threads‚17 disk.dm-0.in‚ 32.453125 disk.rbd2.in‚0 disk.sdb.in‚ 8.8046875 disk.rbd0.in‚0* proc.memory.percent‚18.276572227478027) disk./.usagePercent‚83.16251325577093 disk.dm-0.out‚ 4688.51953125 disk.sda1.out‚0 disk.nvme0n1.out‚ 1015.21875 disk.md0.in‚ 62.48046875$ disk./.usageGB‚2974.294292449951 disk.nvme1n1.in‚ 32.453125# memory_percent‚54.0255069732666( proc.memory.availableMB‚ 7532.4609375Â*é”0Î+ _wandbruntime‚479  _runtime‚479TçfLÃϽ & lr-AdamW/pg1‚0.0008892487708420793 & lr-AdamW/pg2‚0.0008892487708420793 trainer/global_step‚449 $ _timestamp‚1.788478826972599e+09 _runtime‚ 479.082870737 _step‚32ŽsŸ6ÇÐÁ & lr-AdamW/pg1‚0.0008892487708420793 & lr-AdamW/pg2‚0.0008892487708420793 trainer/global_step‚449 $ _timestamp‚1.788478826972599e+09 _runtime‚ 479.082870737 _step‚32 âø0Ñ+ _wandbruntime‚479  _runtime‚479.É>Å'Ò¿O K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚9783294 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚4844135 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚9805272 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚59780039656448 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚59312412178464 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚60260928126976 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 480888470528 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚51423852766208 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚33 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚59780022617088 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 521953815552 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 148321280 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚59780022617088 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚60260128273408 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚58833947670288 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚7862590 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚9805272 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚9783294 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 _runtime‚ 479.090817172Ø€B É'ÓÃO M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚17667862 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚60260128273408 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚518 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚51945633356800 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 trainer/global_step‚449 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚59780022617088 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚60260128273408 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚58833947670288 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 OCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚7862590 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 SGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚9805272 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 OCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚9783294 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 _runtime‚ 479.090817172 K?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚9783294 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚4844135 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 OCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚9805272 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚59780039656448 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚59312412178464 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚60260928126976 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 480888470528 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚51423852766208 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚33 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚59780022617088 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 521953815552 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 148321280 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 I8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚59444923639958 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 479544292862 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚60394745790976 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚59912790968320 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚507 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 523115460608 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 _step‚34 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚9826986 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚51537971665408 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚17685022 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚60393945924096 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚9804982 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚58964580831968 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚59912790968320 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚4854892 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 481171995136 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚4854895 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚58964597871328 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2264800 E=DeviceStatsMonisôÏ–˜tor.on_train_batch_end/segment.small_pool.peak‚475 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚7119188 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚59912773928960 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚504 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 150405120 _runtime‚ 479.935931819 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚9826986 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 175308800 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚51537996569088 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚17707028 ODeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 481171995136 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚7880040 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚17707028 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚7880042 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚7119695 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚52061112029696 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 481954822656 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 481954822656 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743ª0ÒŸÓ&ÖÍM REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚51537996569088 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚17707028 ODeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 481171995136 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚7880040 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚17707028 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚7880042 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚7119695 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚52061112029696 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 481954822656 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 481954822656 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚17685022 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚2264296 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 I=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚9804982 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 480325768630 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚7880042 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚59444923639958 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 479544292862 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚60394745790976 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚59912790968320 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚507 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 523115460608 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 _step‚34 MADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚9826986 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚51537971665408 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚17685022 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚60393945924096 MADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚9804982 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚58964580831968 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚59912790968320 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚4854892 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 481171995136 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚4854895 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚58964597871328 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2264800 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚7119188 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚59912773928960 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚504 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 150405120 _runtime‚ 479.935931819 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 QEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚9826986 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 175308800 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784"ߟ!0×+ _wandbruntime‚479  _runtime‚479_¥ºúTØÎ /loss/FRt4/assignment_loss‚5.815130292244677 0loss/FBt2/assignment_loss‚0.5146249387180433 0loss/FBt3/assignment_loss‚0.5440816578196528 .loss/FBt1/detection_loss‚1.376495146533338 .loss/FBt2/detection_loss‚4.576641845703125 0loss/SRqqt3/detection_loss‚2.786179333383387 0loss/SRqqt4/detection_loss‚2.160126195504115 %loss/total_loss‚65.21980043093632 % _timestamp‚1.7884788278279555e+09 /loss/FRt3/assignment_loss‚6.156162820543561 2loss/SRqqt3/assignment_loss‚2.9755195812745527 /loss/FRt1/detection_loss‚1.9533010998242337 _runtime‚ 479.937987648 1loss/FBt1/assignment_loss‚0.31532712008383973 .loss/FRt2/detection_loss‚2.798589435278201 1loss/SRqqt2/detection_loss‚2.5809334290027617 /loss/FBt4/detection_loss‚2.5065934602171183 _step‚35 1loss/SRqqt2/assignment_loss‚2.882526124318441 /loss/FRt2/assignment_loss‚5.994649643991508 /loss/FRt3/detection_loss‚3.4018667016710555 epoch‚0 /loss/FBt3/detection_loss‚1.5741953933068953 0loss/FRt1/assignment_loss‚4.5388039384089724 2loss/SRqqt1/assignment_loss‚2.0038125174660837 0loss/FBt4/assignment_loss‚0.7951494579976952 /loss/FRt4/detection_loss‚2.3153528174701727 1loss/SRqqt1/detection_loss‚1.4546872668929638 trainer/global_step‚449 2loss/SRqqt4/assignment_loss‚3.1990502132819247+¯ð XÙÒ 1loss/SRqqt2/detection_loss‚2.5809334290027617 /loss/FBt4/detection_loss‚2.5065934602171183 _step‚35 1loss/SRqqt2/assignment_loss‚2.882526124318441 /loss/FRt2/assignment_loss‚5.994649643991508 /loss/FRt3/detection_loss‚3.4018667016710555 epoch‚0 /loss/FBt3/detection_loss‚1.5741953933068953 0loss/FRt1/assignment_loss‚4.5388039384089724 2loss/SRqqt1/assignment_loss‚2.0038125174660837 0loss/FBt4/assignment_loss‚0.7951494579976952 /loss/FRt4/detection_loss‚2.3153528174701727 1loss/SRqqt1/detection_loss‚1.4546872668929638 trainer/global_step‚449 2loss/SRqqt4/assignment_loss‚3.1990502132819247 /loss/FRt4/assignment_loss‚5.815130292244677 0loss/FBt2/assignment_loss‚0.5146249387180433 0loss/FBt3/assignment_loss‚0.5440816578196528 .loss/FBt1/detection_loss‚1.376495146533338 .loss/FBt2/detection_loss‚4.576641845703125 0loss/SRqqt3/detection_loss‚2.786179333383387 0loss/SRqqt4/detection_loss‚2.160126195504115 %loss/total_loss‚65.21980043093632 % _timestamp‚1.7884788278279555e+09 /loss/FRt3/assignment_loss‚6.156162820543561 2loss/SRqqt3/assignment_loss‚2.9755195812745527 /loss/FRt1/detection_loss‚1.9533010998242337 _runtime‚ 479.937987648 1loss/FBt1/assignment_loss‚0.31532712008383973 .loss/FRt2/detection_loss‚2.798589435278201#ãÔ° “Ú‚(:ˆ ëŠèÔ㌲« gpu.0.gpu‚24.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚116.306' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.0765 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0íÐZÏ4Û‚(:© ëŠèÔ–î›° network.recv‚246154 disk.sdb2.in‚ 8.8046875 disk.sdb2.out‚56.01123046875 disk.rbd0.out‚0 disk.sda1.out‚0 disk.sda2.in‚ 53.67578125 disk.md0p1.out‚54.125 disk.nvme0n1.in‚0" disk.nvme0n1.out‚ 1063.97265625 disk.nvme1n1.in‚ 32.453125% proc.memory.availableMB‚ 7532.6875 cpu‚25.112014857689676 disk.sda2.out‚56.01123046875 disk.dm-0.out‚ 4738.828125 disk.sda.out‚56.01123046875* proc.memory.percent‚18.276572227478027$ memory_percent‚54.02412414550781 disk.md0.in‚ 62.48046875 disk.md0.out‚54.125 disk.sdb1.out‚0" disk.nvme1n1.out‚ 3674.85546875 disk.sdb.in‚ 8.8046875 disk.sdb.out‚56.01123046875 network.sent‚622244 disk.rbd2.in‚0 disk.sda.in‚ 53.67578125) disk./.usagePercent‚83.14428945057368$ disk./.usageGB‚2973.642520904541 disk.rbd0.in‚0 disk.sda1.in‚0# proc.memory.rssMB‚ 2994.43359375 disk.md0p1.in‚ 62.48046875 disk.dm-0.in‚ 32.453125 disk.rbd2.out‚0 disk.sdb1.in‚0 proc.cpu.threads‚178z,—•Ü‚(:Š úŠèÔ€Ïü© gpu.0.gpu‚85.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚228.307' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.07675 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 E:Ý‚(:¯ úŠèÔ쨀®# proc.memory.rssMB‚ 2994.43359375* proc.memory.percent‚18.276572227478027 disk.nvme1n1.in‚ 32.453125 disk.md0.in‚ 62.48046875 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sdb2.in‚ 8.8046875( disk./.usagePercent‚83.1442875306841 disk.sda1.in‚0 disk.dm-0.out‚ 4739.0703125) proc.memory.availableMB‚ 7532.63671875% disk./.usageGB‚2973.6424522399902 disk.sdb.in‚ 8.8046875 disk.sdb1.out‚0% memory_percent‚54.024434089660645 proc.cpu.threads‚17 disk.nvme0n1.out‚ 1064.078125 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 56.0546875 network.sent‚660099 disk.sda1.out‚0! disk.nvme1n1.out‚ 3674.9921875 disk.rbd0.out‚0 disk.rbd2.in‚0 cpu‚25.11989342113993 network.recv‚250725 disk.sda.in‚ 53.67578125 disk.sda.out‚ 58.0107421875 disk.sdb.out‚ 58.0107421875 disk.sda2.out‚ 58.0107421875 disk.nvme0n1.in‚0 disk.sdb2.out‚ 58.0107421875 disk.sda2.in‚ 53.67578125 disk.md0.out‚ 56.0546875 disk.dm-0.in‚ 32.453125 disk.rbd2.out‚0=\µ“Þ‚(:ˆ ‰‹èÔ£ÍÆ« gpu.0.gpu‚10.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.966' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.9915 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Þ57ß‚(:¬ ‰‹èÔÚÂÿ« disk.rbd0.out‚0 disk.sdb1.in‚0 disk.sda2.in‚ 53.67578125) disk./.usagePercent‚83.15006650497499 disk.md0.out‚ 57.57421875 disk.rbd2.out‚0# proc.memory.rssMB‚ 2994.43359375 disk.md0p1.in‚ 62.48046875 disk.sda.out‚ 59.591796875 disk.sdb2.in‚ 8.8046875 disk.sda2.out‚ 59.591796875* proc.memory.percent‚18.276572227478027 network.recv‚256036 disk.sda.in‚ 53.67578125 disk.nvme0n1.in‚0$ proc.memory.availableMB‚7532.625 disk.md0.in‚ 62.48046875 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.453125 disk.sdb.in‚ 8.8046875% memory_percent‚54.024505615234375 network.sent‚667099 disk.rbd0.in‚0 disk.dm-0.out‚ 4909.76171875! disk.nvme0n1.out‚ 1234.4765625 disk.sdb2.out‚ 59.591796875 cpu‚25.126404677306418 proc.cpu.threads‚17 disk.dm-0.in‚ 32.453125 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda1.in‚0" disk.nvme1n1.out‚ 3675.28515625 disk.sdb.out‚ 59.591796875$ disk./.usageGB‚2973.849136352539 disk.md0p1.out‚ 57.57421875ɧ«°”à‚(:‰ ˜‹èÔÖ㬠gpu.0.gpu‚60.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.966' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.9915 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ä×Â@á‚(:µ ˜‹èÔ ´î­ network.recv‚260321 disk.dm-0.in‚ 32.453125# disk./.usageGB‚2973.85111618042 disk.sdb.in‚ 8.8046875 disk.sdb2.out‚61.01611328125 disk.sda2.in‚ 53.67578125 proc.cpu.threads‚17 disk.nvme1n1.in‚ 32.453125 disk.sdb1.in‚0" disk.nvme0n1.out‚ 1329.61328125 disk.md0.out‚ 58.9453125 disk.rbd2.out‚0 cpu‚25.135321666497294 disk.md0p1.out‚ 58.9453125 disk.rbd0.out‚0 disk.rbd2.in‚0% memory_percent‚54.024553298950195# proc.memory.rssMB‚ 2994.43359375! disk.nvme1n1.out‚ 3675.3515625 disk.sdb1.out‚0 disk.sda.in‚ 53.67578125 disk.sda1.in‚0 disk.nvme0n1.in‚0 network.sent‚672833 disk.sda2.out‚61.01611328125( proc.memory.availableMB‚ 7532.6171875) disk./.usagePercent‚83.15012186179116 disk.md0p1.in‚ 62.48046875 disk.dm-0.out‚ 5004.96484375 disk.sda.out‚61.01611328125 disk.sda1.out‚0 disk.sdb.out‚61.01611328125 disk.sdb2.in‚ 8.8046875 disk.md0.in‚ 62.48046875 disk.rbd0.in‚0* proc.memory.percent‚18.276572227478027æF0â+ _wandbruntime‚530  _runtime‚530F3ƒ~Äã¾ trainer/global_step‚499 % _timestamp‚1.7884788784634817e+09 _runtime‚ 530.576968106 _step‚36 & lr-AdamW/pg1‚0.0009882742464369656 & lr-AdamW/pg2‚0.0009882742464369656fm‚öÈä & lr-AdamW/pg1‚0.0009882742464369656 & lr-AdamW/pg2‚0.0009882742464369656 trainer/global_step‚499 % _timestamp‚1.7884788784634817e+09 _runtime‚ 530.576968106 _step‚36$`Ѓ0å+ _wandbruntime‚530  _runtime‚530ìï­*#æÃO OCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚8735188 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚65366440682928 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚66951038636032 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 579904674304 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚19606234 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚10893024 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚37 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚10871046 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 150418432 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚66951838489600 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 175322112 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 533450425344 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚66417605250048 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚57710772262400 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚10871046 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 150418432 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚66951838489600 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 175322112 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 533450425344 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚66417605250048 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚57710772262400 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 [HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚65366440682928 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚66951038636032 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 579904674304 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚19606234 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚10893024 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚37 IDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚7909597 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2517229 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 532708731170 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚19645374 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚8752642 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 % _timestamp‚1.7884788793183596e+09 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚66550339522560 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚5392895 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚10914738 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 165085184 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚19645374 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚7910124 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 535299591680 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 534516764160 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚66550356561920 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚19667380 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚65497107923328 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚67085656153600 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚67085656153600 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚66550356561920 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚19667380 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚527 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0òiU(×&êÑM 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚65497107923328 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚67085656153600 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚67085656153600 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚66550356561920 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚19667380 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚527 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚67084856286720 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 534516764160 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189988864 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 581056627200 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 580891542016 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚7909597 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2517229 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 532708731170 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚19645374 QEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚8752642 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 % _timestamp‚1.7884788793183596e+09 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚66550339522560 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚5392895 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚10914738 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 165085184 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚19645374 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚7910124 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 535299591680 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 534516764160 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚66550356561920 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚19667380& ­r0ë+ _wandbruntime‚531  _runtime‚531vkÙ JìÆ _runtime‚ 531.431680924 0loss/FBt4/assignment_loss‚0.6913634171869489 0loss/SRqqt4/detection_loss‚2.092964718035892 1loss/SRqqt2/assignment_loss‚2.739660616715749 1loss/SRqqt3/assignment_loss‚3.011920506539552 1loss/SRqqt3/detection_loss‚3.0099698045979375 _step‚39 /loss/FRt3/assignment_loss‚5.871994076353131 /loss/FRt1/detection_loss‚1.8148523235966445 -loss/FRt3/detection_loss‚3.83947800506245 0loss/SRqqt2/detection_loss‚2.320912288957172 .loss/FBt1/detection_loss‚1.302470554476199 .loss/FBt2/detection_loss‚4.902955174446106 $ _timestamp‚1.788478879321212e+09 /loss/FRt1/assignment_loss‚4.319111632693345 .loss/FRt2/assignment_loss‚5.50391665885323 /loss/FRt4/assignment_loss‚5.766985094949101 2loss/SRqqt1/assignment_loss‚1.9961027738026211 2loss/SRqqt4/assignment_loss‚3.1324245528837222 0loss/FBt1/assignment_loss‚0.3570890506788442 0loss/FBt2/assignment_loss‚0.8472853147541173 /loss/FRt4/detection_loss‚2.6891513051611655 0loss/FBt3/assignment_loss‚0.5277834994787419 0loss/SRqqt1/detection_loss‚1.301810689866543 /loss/FBt4/detection_loss‚2.0839069954818115 epoch‚0 trainer/global_step‚499 /loss/FRt2/detection_loss‚2.5212089874242483 .loss/FBt3/detection_loss‚2.134700558208351 %loss/total_loss‚64.780018600203;±ƒ¹62“CûPíÊ /loss/FRt2/detection_loss‚2.5212089874242483 .loss/FBt3/detection_loss‚2.134700558208351 %loss/total_loss‚64.78001860020362 _runtime‚ 531.431680924 0loss/FBt4/assignment_loss‚0.6913634171869489 0loss/SRqqt4/detection_loss‚2.092964718035892 1loss/SRqqt2/assignment_loss‚2.739660616715749 1loss/SRqqt3/assignment_loss‚3.011920506539552 1loss/SRqqt3/detection_loss‚3.0099698045979375 _step‚39 /loss/FRt3/assignment_loss‚5.871994076353131 /loss/FRt1/detection_loss‚1.8148523235966445 -loss/FRt3/detection_loss‚3.83947800506245 0loss/SRqqt2/detection_loss‚2.320912288957172 .loss/FBt1/detection_loss‚1.302470554476199 .loss/FBt2/detection_loss‚4.902955174446106 $ _timestamp‚1.788478879321212e+09 /loss/FRt1/assignment_loss‚4.319111632693345 .loss/FRt2/assignment_loss‚5.50391665885323 /loss/FRt4/assignment_loss‚5.766985094949101 2loss/SRqqt1/assignment_loss‚1.9961027738026211 2loss/SRqqt4/assignment_loss‚3.1324245528837222 0loss/FBt1/assignment_loss‚0.3570890506788442 0loss/FBt2/assignment_loss‚0.8472853147541173 /loss/FRt4/detection_loss‚2.6891513051611655 0loss/FBt3/assignment_loss‚0.5277834994787419 0loss/SRqqt1/detection_loss‚1.301810689866543 /loss/FBt4/detection_loss‚2.0839069954818115 epoch‚0 trainer/global_step‚499'_À•î‚(:Š §‹èÔÉžî« gpu.0.gpu‚60.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚229.155' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.28875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0%}¤?ï‚(:´ §‹èÔáÀ¸®$ memory_percent‚54.02805805206299) proc.memory.availableMB‚ 7532.04296875* proc.memory.percent‚18.276572227478027 disk.sda2.in‚ 53.67578125 disk.sda.out‚ 62.7861328125 proc.cpu.threads‚17 disk.sda1.out‚0 disk.md0.in‚ 62.48046875 disk.rbd0.out‚0" disk.nvme1n1.out‚ 3675.63671875 disk.sda.in‚ 53.67578125 disk.sdb.out‚ 62.7861328125 network.sent‚677478 network.recv‚265489) disk./.usagePercent‚83.15379013081188 disk.md0.out‚ 60.64453125 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 60.64453125 disk.rbd2.in‚0# proc.memory.rssMB‚ 2994.43359375% disk./.usageGB‚2973.9823112487793 disk.sda1.in‚0 disk.dm-0.in‚ 32.453125 disk.dm-0.out‚ 5098.265625 disk.rbd2.out‚0 disk.sdb1.out‚0 cpu‚25.141723146320103 disk.nvme0n1.in‚0" disk.nvme0n1.out‚ 1422.62890625 disk.nvme1n1.in‚ 32.453125 disk.sda2.out‚ 62.7861328125 disk.rbd0.in‚0 disk.sdb.in‚ 8.8046875 disk.sdb2.in‚ 8.8046875 disk.sdb2.out‚ 62.7861328125 disk.sdb1.in‚0¾7NŸð‚(:” ¶‹èÔ‡áý© gpu.0.gpu‚57.0 gpu.0.memory‚15, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ãEÿHCñ‚(:¸ ¶‹èÔýÑ›« disk.sdb2.out‚64.89306640625 disk.sdb1.out‚0 disk.sda1.in‚0$ memory_percent‚54.02696132659912 disk.sdb.out‚64.89306640625 disk.sda2.in‚ 53.67578125 disk.sda2.out‚64.89306640625 disk.md0.in‚ 62.48046875 disk.sdb.in‚ 8.8046875 disk.sda.out‚64.89306640625 disk.sdb2.in‚ 8.8046875 disk.dm-0.out‚ 5142.5859375 disk.sdb1.in‚0 proc.cpu.threads‚17 network.recv‚269637$ disk./.usageGB‚2974.109218597412 disk.nvme0n1.in‚0 disk.md0p1.in‚ 62.48046875 disk.rbd0.out‚0# proc.memory.rssMB‚ 2994.43359375* proc.memory.percent‚18.276572227478027 network.sent‚728118" disk.nvme1n1.out‚ 3675.76171875 disk.md0.out‚ 62.67578125 disk.md0p1.out‚ 62.67578125 disk.rbd0.in‚0 disk.dm-0.in‚ 32.453125 disk.sda1.out‚0) proc.memory.availableMB‚ 7532.22265625) disk./.usagePercent‚83.15733851339452 disk.sda.in‚ 53.67578125 cpu‚25.149830818242634" disk.nvme0n1.out‚ 1466.82421875 disk.nvme1n1.in‚ 32.453125 disk.rbd2.in‚0 disk.rbd2.out‚0iŸ…Гò‚(:ˆ Å‹èԧѫ gpu.0.gpu‚56.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚228.03' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.0075 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‘5Ua;ó‚(:° Å‹èÔ­¨œ¬ network.sent‚733062 disk.dm-0.out‚ 5214.69921875 disk.sda1.in‚0 disk.sda2.out‚66.51025390625% memory_percent‚54.026150703430176 disk.dm-0.in‚ 32.453125 disk.sda2.in‚ 53.67578125* proc.memory.percent‚18.276572227478027 network.recv‚274828 disk.md0.out‚ 64.234375 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 64.234375 disk.sdb1.in‚0 disk.sda1.out‚0 disk.nvme0n1.in‚0# proc.memory.rssMB‚ 2994.43359375 disk.sdb.out‚66.51025390625 disk.sdb2.out‚66.51025390625) disk./.usagePercent‚83.16786420134642 disk.md0.in‚ 62.48046875 disk.rbd0.in‚0 disk.sda.out‚66.51025390625 disk.nvme1n1.in‚ 32.453125 proc.cpu.threads‚17 disk.sdb1.out‚0" disk.nvme0n1.out‚ 1538.57421875 disk.sdb2.in‚ 8.8046875) proc.memory.availableMB‚ 7532.35546875 cpu‚25.15675756263787 disk.rbd2.out‚0$ disk./.usageGB‚2974.485668182373 disk.sda.in‚ 53.67578125 disk.sdb.in‚ 8.8046875 disk.rbd0.out‚0 disk.rbd2.in‚0 disk.nvme1n1.out‚3676.1254yGF0ô+ _wandbruntime‚579  _runtime‚579Q tÂõ¼ _step‚40 % lr-AdamW/pg1‚0.001087299722031852 % lr-AdamW/pg2‚0.001087299722031852 trainer/global_step‚549 % _timestamp‚1.7884789271798034e+09 _runtime‚ 579.290163858wÊÆöÀ % _timestamp‚1.7884789271798034e+09 _runtime‚ 579.290163858 _step‚40 % lr-AdamW/pg1‚0.001087299722031852 % lr-AdamW/pg2‚0.001087299722031852 trainer/global_step‚549(›dÌý0÷+ _wandbruntime‚579  _runtime‚579§Âf;É'øÃO MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚73641948998656 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚73055170843648 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 638070717952 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚73641948998656 K?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚9607788 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚63476303772160 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚62838233054208 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚62838208150528 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚73055170843648 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 637909813760 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚11980776 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884789271809707e+09 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚73055153804288 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 586795194368 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚63476117964288 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185807872 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160904192 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚21566586 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 587578008576 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚72484559674000 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚8683997 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚2764390 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚5920135 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 587578008576 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 XEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚72484559674000 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚8683997 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚2764390 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚5920135 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚73641948998656 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚73055170843648 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 638070717952 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚73641948998656 K?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚9607788 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚63476303772160 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚62838233054208 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚21978 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚62838208150528 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚73055170843648 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 637909813760 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚11980776 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884789271809707e+09 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 799853568 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚73055153804288 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 586795194368 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚63476117964288 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185807872 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 202134016 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160904192 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚21566586 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600)Z’K0ú+ _wandbruntime‚580  _runtime‚580E9HË ûÍM TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 587861533184 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ODeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 586654645246 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 585873169478 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚9625242 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚9625240 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚72615474105446 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚516 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185794560 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚72029600935968 _step‚42 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 588644360704 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2769313 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚73187905116160 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚12002490 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚73776566516224 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚73775766649344 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 639057934848 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 587861533184 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚73187922155520 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚62952351953408 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚21627732 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚21627732 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 J=DeviceStatsMonitor.on_trÌ6oïÇain_batch_end/active.small_pool.freed‚11980486 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 trainer/global_step‚549 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚513 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚73776566516224 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚8700208 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160890880 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚63591595682816 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚72029617975328 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚11980486 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚2768800 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚62952376857088 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 639218825728 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚21605726 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚8699692ЉË0×&üÑM =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 586654645246 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 585873169478 MADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚9625242 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 976775168 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚9625240 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚72615474105446 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚516 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185794560 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚72029600935968 _step‚42 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 588644360704 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚2769313 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚73187905116160 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚12002490 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚73776566516224 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚73775766649344 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 639057934848 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22940826112 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 587861533184 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚73187922155520 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚62952351953408 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚21627732 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚21627732 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚11980486 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 trainer/global_step‚549 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚513 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚73776566516224 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚8700208 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160890880 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚63591595682816 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚72029617975328 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚11980486 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚2768800 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚62952376857088 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 639218825728 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚21605726 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚8699692 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 587861533184 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 O«<…‚(:± ò‹èÔµóÙ« disk.md0.in‚ 62.48046875 disk.sdb.in‚ 8.8046875( disk./.usagePercent‚83.1783064807622 disk.sdb1.out‚0 disk.sdb2.out‚71.55126953125 disk.dm-0.out‚ 5863.93359375 disk.dm-0.in‚ 32.453125 disk.sda2.out‚71.55126953125 disk.md0p1.out‚ 69.078125 disk.sdb1.in‚0 disk.sda.in‚ 53.67578125 disk.nvme1n1.out‚ 3676.5625 disk.sdb2.in‚ 8.8046875# proc.memory.rssMB‚ 2994.43359375 proc.cpu.threads‚17 disk.rbd2.out‚0% disk./.usageGB‚2974.8591346740723 disk.md0p1.in‚ 62.48046875 disk.rbd0.in‚0 disk.rbd0.out‚0 disk.sda.out‚71.55126953125" disk.nvme0n1.out‚ 2187.37109375 disk.sda2.in‚ 53.67578125 disk.sda1.out‚0 disk.sdb.out‚71.55126953125) proc.memory.availableMB‚ 7531.55859375* proc.memory.percent‚18.276572227478027 network.sent‚794385 disk.md0.out‚ 69.078125 disk.nvme0n1.in‚0 disk.nvme1n1.in‚ 32.453125 cpu‚25.178592509250915 network.recv‚289635 disk.rbd2.in‚0 disk.sda1.in‚0$ memory_percent‚54.03101444244385\X0†+ _wandbruntime‚628  _runtime‚628䎗Ýć¾ _runtime‚ 628.417790776 _step‚44 & lr-AdamW/pg1‚0.0011863251976267383 & lr-AdamW/pg2‚0.0011863251976267383 trainer/global_step‚599 % _timestamp‚1.7884789763046346e+09AÿN2Ȉ & lr-AdamW/pg1‚0.0011863251976267383 & lr-AdamW/pg2‚0.0011863251976267383 trainer/global_step‚599 % _timestamp‚1.7884789763046346e+09 _runtime‚ 628.417790776 _step‚44,Ó=4`0‰+ _wandbruntime‚628  _runtime‚628B{„EÍ'ŠÇO P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚13046550 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 696021409280 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 640139963392 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚80332859361280 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 trainer/global_step‚599 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚80333659214848 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚79692719397888 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚23548918 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 % _timestamp‚1.7884789763054693e+09 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚80333659214848 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 637974862460 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚10480390 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚3017869 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 _step‚45 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚27139 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 638756338020 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚68545423198208 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚68545398294528 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 _runtime‚ 628.418060778 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚79692736437248 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 640922777600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚78431477826288 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚69241265091072 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚79692736437248 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 640922777600 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚10480388 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚80332859361280 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚3017348 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚79069435649388 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 695866796544 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 640139963392 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚9476004 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚79692719397888 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 179516416 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚10480390 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 154612736b0XÔë‹ËO RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚13068528 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚10480388 L@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚9475480 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚69241444607488 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 976775168 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22940826112 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚26872 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 640922777600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 _LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚78431477826288 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975414468 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚69241265091072 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798514920 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚79692736437248 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 640922777600 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 976775168 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚10480388 TADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚80332859361280 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚3017348 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚79069435649388 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 695866796544 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511098517 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 640139963392 PDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚9476004 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚79692719397888 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 179516416 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚10480390 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 154612736 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22940826112 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚13046550 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 696021409280 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚21978 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 640139963392 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚80332859361280 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 trainer/global_step‚599 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚27139 UBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚80333659214848 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚79692719397888 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚23548918 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781475560 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 % _timestamp‚1.7884789763054693e+09 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚26872 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚80333659214848 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚21980 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 637974862460 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚10480390 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚3017869 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 _step‚45 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚27139 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 638756338020 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚68545423198208 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 782814208 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚68545398294528 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 _runtime‚ 628.418060778 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚79692736437248 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 782814208 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚21980 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 799853568 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 IDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚79825470709760 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚69356548363776 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160890880 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 641206302208 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3022863 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 639819083554 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚79201947110882 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚78562128027328 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 _step‚46 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚23588084 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 _runtime‚ 629.281505924 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 641989129728 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚10497840 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚9491758 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚68659542097408 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚13090242 ODeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚9491250 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185794560 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚10497842 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚3022358 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚23566078 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 641206302208 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚23588084 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚23566078 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚10497842 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚13068238 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 641989129728 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚79825487749120 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0ís:Ú&ŽÔM YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798515128 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚23566078 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 641206302208 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚23588084 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚23566078 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22940826112 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚10497842 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚13068238 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 641989129728 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚79825487749120 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 639037607786 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚79825487749120 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚79825470709760 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚508 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 trainer/global_step‚599 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚10497840 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚80467476878848 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚22004 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚26872 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 697167157248 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚80466677011968 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 976775168 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚27139 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚69356734158336 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚80467476878848 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚79201148595754 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚22006 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511098517 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 799866880 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚79825470709760 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚69356548363776 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160890880 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 641206302208 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 799866880 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3022863 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 639819083554 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚22004 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚79201947110882 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚78562128027328 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 _step‚46 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚27139 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚23588084 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 _runtime‚ 629.281505924 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 641989129728 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 202134016 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 782827520 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚10497840 NBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚9491758 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚68659542097408 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚13090242 ODeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚9491250 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185794560 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975414468 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚10497842 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 782827520 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚3022358 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781475768 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0.°¶l0+ _wandbruntime‚629  _runtime‚629©eìøSÍ 1loss/SRqqt4/detection_loss‚2.6935327834252156 .loss/FBt2/detection_loss‚4.887828320264816 _runtime‚ 629.282561948 /loss/FRt3/assignment_loss‚5.269660782169652 /loss/FRt4/assignment_loss‚5.351993842352004 2loss/SRqqt2/assignment_loss‚2.0503072388721315 2loss/SRqqt3/assignment_loss‚2.7658520066844567 0loss/FBt3/assignment_loss‚0.7452709710708371 1loss/SRqqt1/detection_loss‚1.2789501359136841 0loss/FRt1/assignment_loss‚3.2350109150367126 /loss/FRt2/assignment_loss‚4.643464292388365 /loss/FBt1/detection_loss‚0.6614132328518753 -loss/FBt3/detection_loss‚2.52699343363444 .loss/FBt4/detection_loss‚2.928006724877791 0loss/FBt1/assignment_loss‚0.3587678222661353 0loss/FBt4/assignment_loss‚0.7767189476977695 /loss/FRt2/detection_loss‚2.1437480973910135 .loss/FRt3/detection_loss‚2.831173212141604 .loss/FRt4/detection_loss‚2.418427840868632 _step‚47 1loss/SRqqt1/assignment_loss‚2.161039189281438 0loss/FBt2/assignment_loss‚0.7467718869447708 1loss/SRqqt2/detection_loss‚2.1379261696606537 1loss/SRqqt3/detection_loss‚2.7638386136719157 &loss/total_loss‚60.062354035002926 % _timestamp‚1.7884789771725283e+09 /loss/FRt1/detection_loss‚1.9603739509891187 epoch‚0 trainer/global_step‚599 2loss/SRqqt4/assignment_loss‚2.7252836245479006Œ'BLW‘Ñ /loss/FRt3/assignment_loss‚5.269660782169652 /loss/FRt4/assignment_loss‚5.351993842352004 2loss/SRqqt2/assignment_loss‚2.0503072388721315 2loss/SRqqt3/assignment_loss‚2.7658520066844567 0loss/FBt3/assignment_loss‚0.7452709710708371 1loss/SRqqt1/detection_loss‚1.2789501359136841 0loss/FRt1/assignment_loss‚3.2350109150367126 /loss/FRt2/assignment_loss‚4.643464292388365 /loss/FBt1/detection_loss‚0.6614132328518753 -loss/FBt3/detection_loss‚2.52699343363444 .loss/FBt4/detection_loss‚2.928006724877791 0loss/FBt1/assignment_loss‚0.3587678222661353 0loss/FBt4/assignment_loss‚0.7767189476977695 /loss/FRt2/detection_loss‚2.1437480973910135 .loss/FRt3/detection_loss‚2.831173212141604 .loss/FRt4/detection_loss‚2.418427840868632 _step‚47 1loss/SRqqt1/assignment_loss‚2.161039189281438 0loss/FBt2/assignment_loss‚0.7467718869447708 1loss/SRqqt2/detection_loss‚2.1379261696606537 1loss/SRqqt3/detection_loss‚2.7638386136719157 &loss/total_loss‚60.062354035002926 % _timestamp‚1.7884789771725283e+09 /loss/FRt1/detection_loss‚1.9603739509891187 epoch‚0 trainer/global_step‚599 2loss/SRqqt4/assignment_loss‚2.7252836245479006 1loss/SRqqt4/detection_loss‚2.6935327834252156 .loss/FBt2/detection_loss‚4.887828320264816 _runtime‚ 629.282561948/ì-Ê,”’‚(:‰ ŒèÔÅèþ© gpu.0.gpu‚60.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚227.082' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.7705 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0"û“‚(:  ŒèÔˆÐƪ disk.sdb.in‚ 8.8046875# proc.memory.rssMB‚ 2994.43359375 disk.dm-0.in‚ 32.453125 disk.nvme1n1.in‚ 32ï «ž.453125" disk.nvme1n1.out‚ 3676.97265625 disk.sdb1.in‚0 disk.sda.out‚ 73.109375 disk.sdb2.out‚ 73.109375 disk.sda2.in‚ 53.67578125 network.recv‚294144) disk./.usagePercent‚83.19234322011047 disk.sdb2.in‚ 8.8046875 disk.md0.in‚ 62.48046875 disk.rbd2.in‚0 disk.rbd2.out‚0( proc.memory.availableMB‚ 7531.8359375 network.sent‚800336 disk.nvme0n1.in‚0 disk.nvme0n1.out‚ 2389.359375 disk.md0.out‚ 70.5703125 disk.rbd0.out‚0 disk.dm-0.out‚ 6066.33203125 proc.cpu.threads‚17 disk.md0p1.in‚ 62.48046875 disk.rbd0.in‚0$ disk./.usageGB‚2975.361156463623 disk.sda2.out‚ 73.109375 disk.sdb1.out‚0 disk.sda.in‚ 53.67578125 disk.md0p1.out‚ 70.5703125* proc.memory.percent‚18.276572227478027 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.out‚ 73.109375$ memory_percent‚54.02932167053223 cpu‚25.184417825773483žvÌ’”‚(:‡ ŒèÔŠÝï gpu.0.gpu‚2.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚36.0 gpu.0.powerWatts‚113.798' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.4495 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0?‰c0A•‚(:¶ ŒèÔڛ̰ disk.rbd2.in‚0 disk.sda.out‚74.67822265625 disk.sdb2.in‚ 8.8046875 network.recv‚298611 disk.md0.in‚ 62.48046875 disk.md0p1.out‚ 72.0703125 disk.sdb.out‚74.67822265625 network.sent‚848578 disk.rbd0.in‚0 disk.dm-0.out‚ 6325.96484375 disk.sda.in‚ 53.67578125 disk.sda1.out‚0! disk.nvme0n1.out‚ 2648.8515625 disk.nvme1n1.in‚ 32.453125 disk.md0.out‚ 72.0703125 disk.md0p1.in‚ 62.48046875 disk.rbd0.out‚0 disk.dm-0.in‚ 32.453125 disk.rbd2.out‚0" disk.nvme1n1.out‚ 3677.11328125 disk.sda2.in‚ 53.67578125 disk.sda2.out‚74.67822265625 disk.sdb1.in‚0 disk.sda1.in‚0$ memory_percent‚54.49492931365967( disk./.usagePercent‚83.1775427913522% disk./.usageGB‚2974.8318214416504) proc.memory.availableMB‚ 7455.55078125# proc.memory.rssMB‚ 3070.44921875* proc.memory.percent‚18.740534782409668 cpu‚25.294368266010327 proc.cpu.threads‚17 disk.sdb2.out‚74.67822265625 disk.nvme0n1.in‚0 disk.sdb1.out‚0 disk.sdb.in‚ 8.8046875p)÷“–‚(:ˆ ŸŒèÔÃɈ« gpu.0.gpu‚21.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚237.934' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚59.4835 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Yݵ=—‚(:² ŸŒèÔ½‡¬¬ disk.md0.in‚ 62.48046875 disk.sda.in‚ 53.67578125) disk./.usagePercent‚83.17753457849123 disk.sda.out‚76.66162109375 disk.nvme1n1.in‚ 32.453125 disk.sdb2.out‚76.66162109375 disk.md0.out‚ 73.98828125 disk.sdb.out‚76.66162109375* proc.memory.percent‚18.825769424438477 proc.cpu.threads‚17 network.sent‚855029 disk.sda2.out‚76.66162109375 disk.dm-0.out‚ 6466.9765625 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sda1.out‚0) proc.memory.availableMB‚ 7441.44921875 network.recv‚302967 disk.nvme0n1.in‚0! disk.nvme0n1.out‚ 2789.6953125 disk.sda2.in‚ 53.67578125 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 73.98828125 disk.dm-0.in‚ 32.453125 disk.sdb.in‚ 8.8046875$ memory_percent‚54.58099842071533" proc.memory.rssMB‚ 3084.4140625 cpu‚25.42010649068072 disk.rbd0.out‚0 disk.nvme1n1.out‚ 3677.28125$ disk./.usageGB‚2974.831527709961 disk.rbd0.in‚0 disk.rbd2.out‚0 disk.sdb1.in‚0 disk.sdb2.in‚ 8.8046875WÈ6Ã@˜b; particle/accuracy_5_of_6"trainer/global_step2:JPVŸÖJ™bE "Purity/3FRt3SRqqt*FBt/event_purity"trainer/global_step2:JPϱSHšbC Purity/*FRt0SRqqt*FBt/FBt_purity"trainer/global_step2:JPÏÙɪJ›bE "Purity/*FRt3SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPrF«¨HœbC Purity/2FRt0SRqqt2FBt/FBt_purity"trainer/global_step2:JP?Ře;b6 jet/accuracy_5_of_6"trainer/global_step2:JP3[£HžbC Purity/2FRt3SRqqt1FBt/FRt_purity"trainer/global_step2:JPl?(JŸbE "Purity/0FRt*SRqqt2FBt/event_purity"trainer/global_step2:JPH…àJH bC Purity/0FRt0SRqqt1FBt/FBt_purity"trainer/global_step2:JPή½ N¡bI &Purity/0FRt3SRqqt2FBt/event_proportion"trainer/global_step2:JPÝÖ»SN¢bI &Purity/1FRt1SRqqt3FBt/event_proportion"trainer/global_step2:JPÚ$âN£bI &Purity/2FRt0SRqqt1FBt/event_proportion"trainer/global_step2:JPŒØ7J¤bE "Purity/*FRt4SRqqt0FBt/SRqqt_purity"trainer/global_step2:JP ²õ;¥b6 jet/accuracy_2_of_6"trainer/global_step2:JP;N(J¦bE "Purity/2FRt2SRqqt2FBt/event_purity"trainer/global_step2:JPÝvÇoJ§bE "Purity/1FRt3SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPúðñJ¨bE "Purity/2FRt2SRqqt1FBt/event_purity"trainer/global_step2:JPÿ½¨¯N©bI &Purity/4FRt1SRqqt0FBt/event_proportion"trainer/global_step2:JP8¼HªbC Purity/4FRt0SRqqt*FBt/FRt_purity"trainer/global_step2:JP«å§N«bI &Purity/0FRt1SRqqt1FBt/event_proportion"trainer/global_step2:JP$è N¬bI &Purity/0FRt2SRqqt2FBt/event_proportion"trainer/global_step2:JP}÷¶«N­bI &Purity/1FRt*SRqqt*FBt/event_proportion"trainer/global_step2:JPÅÈÑãN®bI &Purity/3FRt*SRqqt0FBt/event_proportion"trainer/global_step2:JPцDøJ¯bE "Purity/*FRt1SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPÉ`ÃH°bC Purity/0FRt1SRqqt2FBt/FBt_purity"trainer/global_step2:JP2º„7N±bI &Purity/1FRt4SRqqt0FBt/event_proportion"trainer/global_step2:JP'‘yH²bC Purity/2FRt*SRqqt1FBt/FRt_purity"trainer/global_step2:JPÿñ;³b6 jet/accuracy_5_of_7"trainer/global_step2:JPaF|ªJ´bE "Purity/0FRt2SRqqt3FBt/event_purity"trainer/global_step2:JPGUzvHµbC Purity/*FRt1SRqqt0FBt/FRt_purity"trainer/global_step2:JPƒjN¶bI &Purity/*FRt4SRqqt2FBt/event_proportion"trainer/global_step2:JP?¶`J·bE "Purity/0FRt0SRqqt1FBt/event_purity"trainer/global_step2:JPN¿«[N¸bI &Purity/0FRt0SRqqt4FBt/event_proportion"trainer/global_step2:JP}\YJ¹bE "Purity/3FRt0SRqqt*FBt/event_purity"trainer/global_step2:JPÍD¹ËNºbI &Purity/3FRt3SRqqt0FBt/event_proportion"trainer/global_step2:JP»:ËJ»bE "Purity/*FRt2SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP9!בJ¼bE "Purity/3FRt0SRqqt0FBt/event_purity"trainer/global_step2:JPVm/+H½bC Purity/3FRt0SRqqt1FBt/FRt_purity"trainer/global_step2:JPrf*H¾bC Purity/3FRt3SRqqt*FBt/FRt_purity"trainer/global_step2:JP‚RûKH¿bC Purity/*FRt*SRqqt*FBt/FRt_purity"trainer/global_step2:JP,zæaJÀbE "Purity/1FRt*SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPSCHÁbC Purity/1FRt*SRqqt2FBt/FBt_purity"trainer/global_step2:JPïkO'HÂbC Purity/*FRt2SRqqt1FBt/FRt_purity"trainer/global_step2:JPãšÜJÃbE "Purity/2FRt*SRqqt1FBt/event_purity"trainer/global_step2:JPã)¤JÄbE "Purity/*FRt*SRqqt2FBt/SRqqt_purity"trainer/global_step2:JPo[–MNÅbI &Purity/*FRt1SRqqt4FBt/event_proportion"trainer/global_step2:JPppfJÆbE "Purity/0FRt2SRqqt0FBt/event_purity"trainer/global_step2:JPäh$ËJÇbE "Purity/2FRt*SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPøËýpHÈbC Purity/2FRt2SRqqt1FBt/FBt_purity"trainer/global_step2:JP´† ºJÉbE "Purity/3FRt1SRqqt*FBt/event_purity"trainer/global_step2:JPÔ/…HÊbC Purity/1FRt0SRqqt2FBt/FBt_purity"trainer/global_step2:JP†;4HËbC Purity/1FRt2SRqqt0FBt/FRt_purity"trainer/global_step2:JP8Ã/ÑNÌbI &Purity/2FRt0SRqqt*FBt/event_proportion"trainer/global_step2:JPÝ {JÍbE "Purity/4FRt*SRqqt0FBt/SRqqt_purity"trainer/global_step2:JP¬];„JÎbE "Purity/*FRt2SRqqt1FBt/event_purity"trainer/global_step2:JPª#ªJÏbE "Purity/0FRt0SRqqt2FBt/event_purity"trainer/global_step2:JPuÓKJÐbE "Purity/1FRt*SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP®#óHÑbC Purity/1FRt3SRqqt0FBt/FRt_purity"trainer/global_step2:JPbÓ“*JÒbE "Purity/1FRt*SRqqt4FBt/event_purity"trainer/global_step2:JP·†ŸXHÓbC Purity/*FRt0SRqqt3FBt/FBt_purity"trainer/global_step2:JPæ×@Ôb; particle/accuracy_1_of_5"trainer/global_step2:JPWŒUµJÕbE "Purity/3FRt0SRqqt2FBt/event_purity"trainer/global_step2:JP¿îÝJÖbE "Purity/0FRt*SRqqt3FBt/SRqqt_purity"trainer/global_step2:JP®?ËJ×bE "Purity/0FRt1SRqqt0FBt/event_purity"trainer/global_step2:JPžœNØbI &Purity/0FRt3SRqqt1FBt/event_proportion"trainer/global_step2:JPÿçöJÙbE "Purity/1FRt1SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP·UNÚbI &Purity/1FRt1SRqqt1FBt/event_proportion"trainer/global_step2:JPÖHÛbC Purity/2FRt1SRqqt*FBt/FBt_purity"trainer/global_step2:JPB†\ðHÜbC Purity/0FRt4SRqqt1FBt/FBt_purity"trainer/global_step2:JPÈø[@Ýb; particle/accuracy_3_of_6"trainer/global_step2:JP]a¼@Þb; particle/accuracy_4_of_7"trainer/global_step2:JPÙÈaANßbI &Purity/2FRt*SRqqt0FBt/event_proportion"trainer/global_step2:JPuÛ;àb6 jet/accuracy_2_of_2"trainer/global_step2:JPÚ[sU@áb; particle/accuracy_1_of_1"trainer/global_step2:JPuí¹NâbI &Purity/2FRt3SRqqt*FBt/event_proportion"trainer/global_step2:JPÏä›jJãbE "Purity/3FRt*SRqqt0FBt/event_purity"trainer/global_step2:JP˾ÓNäbI &Purity/3FRt0SRqqt4FBt/event_proportion"trainer/global_step2:JP7£†oNåbI &Purity/4FRt1SRqqt4FBt/event_proportion"trainer/global_step2:JPB0GýHæbC Purity/*FRt*SRqqt2FBt/FBt_purity"trainer/global_step2:JP¬þüHçbC Purity/1FRt*SRqqt*FBt/FRt_purity"trainer/global_step2:JPx7NèbI &Purity/2FRt1SRqqt2FBt/event_proportion"trainer/global_step2:JPhûZÁJébE "Purity/*FRt*SRqqt4FBt/event_purity"trainer/global_step2:JPRŽÄ“JêbE "Purity/0FRt4SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP1•R˜NëbI &Purity/1FRt*SRqqt0FBt/event_proportion"trainer/global_step2:JP¿¤‚:HìbC Purity/1FRt0SRqqt*FBt/FRt_purity"trainer/global_step2:JP‘mD_NíbI &Purity/1FRt4SRqqt4FBt/event_proportion"trainer/global_step2:JPU|à„JîbE "Purity/0FRt4SRqqt1FBt/event_purity"trainer/global_step2:JP¢TýJïbE "Purity/3FRt*SRqqt2FBt/event_purity"trainer/global_step2:JPJ+˜_HðbC Purity/1FRt1SRqqt*FBt/FBt_purity"trainer/global_step2:JP¡Š…5;ñb6 jet/accuracy_1_of_2"trainer/global_step2:JPÔ(ôéHòbC Purity/*FRt2SRqqt2FBt/FRt_purity"trainer/global_step2:JP‘ÿúNóbI &Purity/3FRt0SRqqt2FBt/event_proportion"trainer/global_step2:JPC—;WHôbC Purity/1FRt1SRqqt4FBt/FBt_purity"trainer/global_step2:JPѦ!.HõbC Purity/1FRt1SRqqt3FBt/FRt_purity"trainer/global_step2:JPÍ>`~HöbC Purity/*FRt3SRqqt*FBt/FBt_purity"trainer/global_step2:JP+CµAN÷bI &Purity/1FRt1SRqqt4FBt/event_proportion"trainer/global_step2:JP8ó=ïJøbE "Purity/3FRt2SRqqt*FBt/event_purity"trainer/global_step2:JP›ÜÄ·NùbI &Purity/4FRt*SRqqt1FBt/event_proportion"trainer/global_step2:JPZåw´;úb6 jet/accuracy_2_of_7"trainer/global_step2:JP+ØÇQHûbC Purity/3FRt0SRqqt2FBt/FRt_purity"trainer/global_step2:JPÈ̃lNübI &Purity/*FRt*SRqqt3FBt/event_proportion"trainer/global_step2:JPð$©üNýbI &Purity/1FRt3SRqqt*FBt/event_proportion"trainer/global_step2:JPP¿ÔxJþbE "Purity/2FRt2SRqqt*FBt/event_purity"trainer/global_step2:JPu7#1JÿbE "Purity/2FRt*SRqqt3FBt/event_purity"trainer/global_step2:JPáÞS'J€bE "Purity/3FRt3SRqqt0FBt/event_purity"trainer/global_step2:JPãé÷WHbC Purity/*FRt1SRqqt1FBt/FBt_purity"trainer/global_step2:JPwfLîH‚bC Purity/2FRt*SRqqt2FBt/FRt_purity"trainer/global_step2:JP†6HƒbC Purity/3FRt*SRqqt*FBt/FBt_purity"trainer/global_step2:JPéú»:@„b; particle/accuracy_3_of_4"trainer/global_step2:JP–çY‰J…bE "Purity/2FRt3SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPX¨ÔH†bC Purity/1FRt1SRqqt3FBt/FBt_purity"trainer/global_step2:JPIà—nJ‡bE "Purity/1FRt3SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP¥þçÑJˆbE "Purity/4FRt1SRqqt*FBt/event_purity"trainer/global_step2:JPÈúÐéJ‰bE "Purity/1FRt*SRqqt3FBt/event_purity"trainer/global_step2:JP-ª ÆHŠbC Purity/2FRt0SRqqt*FBt/FRt_purity"trainer/global_step2:JPðH[VH‹bC Purity/*FRt4SRqqt*FBt/FRt_purity"trainer/global_step2:JP—ËBJŒbE "Purity/0FRt0SRqqt4FBt/event_purity"trainer/global_step2:JPÈÊ´NbI &Purity/0FRt3SRqqt*FBt/event_proportion"trainer/global_step2:JP-ÛÔJŽbE "Purity/3FRt1SRqqt1FBt/event_purity"trainer/global_step2:JP,®éÜ@b; particle/accuracy_3_of_3"trainer/global_step2:JP7]º²;b6 jet/accuracy_4_of_6"trainer/global_step2:JP×fY:J‘bE "Purity/0FRt1SRqqt3FBt/SRqqt_purity"trainer/global_step2:JP¾”>ŠN’bI &Purity/*FRt1SRqqt1FBt/event_proportion"trainer/global_step2:JP¹+è:H“bC Purity/0FRt*SRqqt1FBt/FBt_purity"trainer/global_step2:JP¡àf H”bC Purity/1FRt2SRqqt1FBt/FBt_purity"trainer/global_step2:JPdÝŠN•bI &Purity/2FRt1SRqqt3FBt/event_proportion"trainer/global_step2:JPMX¹ÇJ–bE "Purity/3FRt1SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP¡ª@—b; particle/accuracy_2_of_5"trainer/global_step2:JPÂx”@˜b; particle/accuracy_1_of_6"trainer/global_step2:JPÉB6J™bE "Purity/1FRt3SRqqt*FBt/event_purity"trainer/global_step2:JPQÔ+HšbC Purity/2FRt2SRqqt0FBt/FRt_purity"trainer/global_step2:JP„k“ŠH›bC Purity/3FRt1SRqqt*FBt/FBt_purity"trainer/global_step2:JPWBþ];œb6 jet/accuracy_4_of_7"trainer/global_step2:JP \0ƒJbE "Purity/*FRt*SRqqt3FBt/event_purity"trainer/global_step2:JPœèšÖNžbI &Purity/*FRt4SRqqt3FBt/event_proportion"trainer/global_step2:JP«ÚÝlJŸbE "Purity/2FRt3SRqqt1FBt/event_purity"trainer/global_step2:JP”éJ bE "Purity/*FRt*SRqqt*FBt/event_purity"trainer/global_step2:JP‚––H¡bC Purity/1FRt3SRqqt1FBt/FBt_purity"trainer/global_step2:JPaˆ‘WN¢bI &Purity/3FRt3SRqqt2FBt/event_proportion"trainer/global_step2:JP÷®ÀøJ£bE "Purity/2FRt4SRqqt0FBt/SRqqt_purity"trainer/global_step2:JP-5,;¤b6 jet/accuracy_7_of_7"trainer/global_step2:JP ÆKJ¥bE "Purity/*FRt1SRqqt0FBt/event_purity"trainer/global_step2:JPŽ|:N¦bI &Purity/1FRt4SRqqt2FBt/event_proportion"trainer/global_step2:JP^°6íH§bC Purity/2FRt0SRqqt1FBt/FBt_purity"trainer/global_step2:JP5v«H¨bC Purity/*FRt4SRqqt1FBt/FBt_purity"trainer/global_step2:JP  MH©bC Purity/*FRt*SRqqt0FBt/FRt_purity"trainer/global_step2:JP•]®­NªbI &Purity/1FRt0SRqqt1FBt/event_proportion"trainer/global_step2:JP¸`¤N«bI &Purity/4FRt*SRqqt3FBt/event_proportion"trainer/global_step2:JP»”wJ¬bE "Purity/0FRt1SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP¤Ð„ N­bI &Purity/1FRt4SRqqt*FBt/event_proportion"trainer/global_step2:JPòe¹H®bC Purity/3FRt*SRqqt1FBt/FRt_purity"trainer/global_step2:JPm*&J¯bE "Purity/1FRt2SRqqt2FBt/event_purity"trainer/global_step2:JP"mª@°b; particle/accuracy_2_of_7"trainer/global_step2:JPœÝvH±bC Purity/0FRt3SRqqt*FBt/FBt_purity"trainer/global_step2:JPe¹SAH²bC Purity/3FRt3SRqqt0FBt/FRt_purity"trainer/global_step2:JPÄÙz¾H³bC Purity/*FRt1SRqqt*FBt/FRt_purity"trainer/global_step2:JPü”žN´bI &Purity/4FRt0SRqqt*FBt/event_proportion"trainer/global_step2:JP~v ¹JµbE "Purity/0FRt3SRqqt0FBt/event_purity"trainer/global_step2:JP,ÓmH¶bC Purity/0FRt1SRqqt1FBt/FBt_purity"trainer/global_step2:JP=9—N·bI &Purity/0FRt2SRqqt3FBt/event_proportion"trainer/global_step2:JPÒŒ3èN¸bI &Purity/1FRt*SRqqt1FBt/event_proportion"trainer/global_step2:JP×:3r;¹b6 jet/accuracy_3_of_5"trainer/global_step2:JP~W?=JºbE "Purity/3FRt3SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPõèþIH»bC Purity/1FRt3SRqqt*FBt/FRt_purity"trainer/global_step2:JPë]Ù@¼b; particle/accuracy_4_of_5"trainer/global_step2:JP‰.Ú*J½bE "Purity/*FRt0SRqqt2FBt/event_purity"trainer/global_step2:JP^š‡H¾bC Purity/*FRt0SRqqt2FBt/FRt_purity"trainer/global_step2:JPþÌìJ¿bE "Purity/*FRt3SRqqt*FBt/event_purity"trainer/global_step2:JP7k˜ÊJÀbE "Purity/0FRt1SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP¢2NÁbI &Purity/1FRt*SRqqt3FBt/event_proportion"trainer/global_step2:JP[MMðHÂbC Purity/1FRt2SRqqt*FBt/FRt_purity"trainer/global_step2:JP“ ÷NÃbI &Purity/2FRt1SRqqt1FBt/event_proportion"trainer/global_step2:JPd9JÄbE "Purity/2FRt1SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP‘NÅbI &Purity/*FRt0SRqqt0FBt/event_proportion"trainer/global_step2:JP ®ð/HÆbC Purity/0FRt0SRqqt2FBt/FBt_purity"trainer/global_step2:JP¹ÊÒtNÇbI &Purity/3FRt3SRqqt*FBt/event_proportion"trainer/global_step2:JP´o„rHÈbC Purity/3FRt1SRqqt1FBt/FRt_purity"trainer/global_step2:JP#„¥‘;Éb6 jet/accuracy_5_of_5"trainer/global_step2:JPö-f‰@Êb; particle/accuracy_2_of_4"trainer/global_step2:JP`ý—ÏNËbI &Purity/*FRt3SRqqt*FBt/event_proportion"trainer/global_step2:JPù"K¿JÌbE "Purity/0FRt*SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPD{v…NÍbI &Purity/0FRt1SRqqt0FBt/event_proportion"trainer/global_step2:JPfÁ8JÎbE "Purity/1FRt*SRqqt*FBt/event_purity"trainer/global_step2:JP“¨.NÏbI &Purity/1FRt*SRqqt2FBt/event_proportion"trainer/global_step2:JPZ{àýNÐbI &Purity/4FRt3SRqqt4FBt/event_proportion"trainer/global_step2:JPQDS·;Ñb6 jet/accuracy_4_of_4"trainer/global_step2:JPÈa¯JÒbE "Purity/*FRt*SRqqt3FBt/SRqqt_purity"trainer/global_step2:JP§·²†NÓbI &Purity/*FRt1SRqqt3FBt/event_proportion"trainer/global_step2:JPË™úNÔbI &Purity/*FRt4SRqqt1FBt/event_proportion"trainer/global_step2:JP7h×NÕbI &Purity/0FRt4SRqqt*FBt/event_proportion"trainer/global_step2:JPJÁ.ùHÖbC Purity/1FRt*SRqqt1FBt/FBt_purity"trainer/global_step2:JP’ãµJ×bE "Purity/1FRt0SRqqt*FBt/event_purity"trainer/global_step2:JPÄ NØbI &Purity/1FRt0SRqqt3FBt/event_proportion"trainer/global_step2:JP¥VZ¾JÙbE "Purity/2FRt*SRqqt2FBt/event_purity"trainer/global_step2:JPs$ˆ}@Úb; particle/accuracy_2_of_3"trainer/global_step2:JPÆWekJÛbE "Purity/1FRt1SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPŒü€JÜbE "Purity/1FRt1SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP_'p‰JÝbE "Purity/2FRt3SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPÝ1=¼JÞbE "Purity/3FRt1SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP=‹„áJßbE "Purity/3FRt1SRqqt2FBt/event_purity"trainer/global_step2:JP€BˆŸHàbC Purity/*FRt0SRqqt4FBt/FRt_purity"trainer/global_step2:JP< ÁJábE "Purity/*FRt*SRqqt0FBt/event_purity"trainer/global_step2:JP6ŠNâbI &Purity/0FRt1SRqqt*FBt/event_proportion"trainer/global_step2:JPK¬HãbC Purity/2FRt1SRqqt1FBt/FRt_purity"trainer/global_step2:JP¢è)NäbI &Purity/3FRt1SRqqt*FBt/event_proportion"trainer/global_step2:JP‰ÀD«NåbI &Purity/3FRt4SRqqt0FBt/event_proportion"trainer/global_step2:JPñ¼:(JæbE "Purity/*FRt2SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP­õ.=HçbC Purity/*FRt3SRqqt1FBt/FRt_purity"trainer/global_step2:JPBòš¾|N€bI &Purity/4FRt1SRqqt3FBt/event_proportion"trainer/global_step2:JP*;;:;b6 jet/accuracy_3_of_3"trainer/global_step2:JPÛq¹¨N‚bI &Purity/*FRt3SRqqt3FBt/event_proportion"trainer/global_step2:JP¦[ÃðJƒbE "Purity/4FRt*SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPMÅýH„bC Purity/*FRt*SRqqt3FBt/FBt_purity"trainer/global_step2:JP²ÚnH…bC Purity/*FRt1SRqqt2FBt/FRt_purity"trainer/global_step2:JP&ÒN†bI &Purity/*FRt2SRqqt2FBt/event_proportion"trainer/global_step2:JPaãX H‡bC Purity/2FRt*SRqqt1FBt/FBt_purity"trainer/global_step2:JPî§IzJˆbE "Purity/3FRt*SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP<Ô÷ N‰bI &Purity/4FRt0SRqqt4FBt/event_proportion"trainer/global_step2:JPTÖ•“JŠbE "Purity/0FRt4SRqqt0FBt/event_purity"trainer/global_step2:JPïiNîJ‹bE "Purity/3FRt*SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP¶û' JŒbE "Purity/*FRt0SRqqt0FBt/event_purity"trainer/global_step2:JPy؇HbC Purity/0FRt2SRqqt1FBt/FBt_purity"trainer/global_step2:JP’•{@NŽbI &Purity/0FRt4SRqqt3FBt/event_proportion"trainer/global_step2:JP»óè-JbE "Purity/3FRt*SRqqt*FBt/event_purity"trainer/global_step2:JPŠQ,7NbI &Purity/3FRt2SRqqt*FBt/event_proportion"trainer/global_step2:JPøÄQ6J‘bE "Purity/3FRt2SRqqt0FBt/event_purity"trainer/global_step2:JP½ ñ¯;’b6 jet/accuracy_6_of_7"trainer/global_step2:JP„8†J“bE "Purity/1FRt1SRqqt4FBt/event_purity"trainer/global_step2:JP`zC@J”bE "Purity/0FRt0SRqqt3FBt/event_purity"trainer/global_step2:JP³„~*J•bE "Purity/1FRt0SRqqt0FBt/event_purity"trainer/global_step2:JPþ˜?N–bI &Purity/3FRt4SRqqt1FBt/event_proportion"trainer/global_step2:JP–%#ÚH—bC Purity/3FRt1SRqqt2FBt/FBt_purity"trainer/global_step2:JP+Í™H˜bC Purity/*FRt0SRqqt*FBt/FRt_purity"trainer/global_step2:JPÈ_N™bI &Purity/0FRt0SRqqt0FBt/event_proportion"trainer/global_step2:JP†ÿÖNšbI &Purity/1FRt4SRqqt3FBt/event_proportion"trainer/global_step2:JP…¸NuN›bI &Purity/2FRt*SRqqt3FBt/event_proportion"trainer/global_step2:JPpÈlþNœbI &Purity/3FRt4SRqqt4FBt/event_proportion"trainer/global_step2:JPÂ"íE@b; particle/accuracy_4_of_6"trainer/global_step2:JPéŸ7ãHžbC Purity/1FRt2SRqqt2FBt/FRt_purity"trainer/global_step2:JP®$C¾NŸbI &Purity/1FRt3SRqqt2FBt/event_proportion"trainer/global_step2:JPÈÕ ; b6 jet/accuracy_2_of_5"trainer/global_step2:JPúàÿ;¡b6 jet/accuracy_1_of_6"trainer/global_step2:JP˜“(YH¢bC Purity/2FRt3SRqqt1FBt/FBt_purity"trainer/global_step2:JPáÜå²J£bE "Purity/3FRt4SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPê×2(J¤bE "Purity/1FRt4SRqqt*FBt/event_purity"trainer/global_step2:JP»wŠN¥bI &Purity/*FRt0SRqqt4FBt/event_proportion"trainer/global_step2:JPW•âvJ¦bE "Purity/*FRt1SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP˜…kN§bI &Purity/1FRt1SRqqt2FBt/event_proportion"trainer/global_step2:JPÀÇüJ¨bE "Purity/3FRt*SRqqt1FBt/event_purity"trainer/global_step2:JP(EìÎH©bC Purity/3FRt2SRqqt*FBt/FRt_purity"trainer/global_step2:JP R¢nNªbI &Purity/2FRt2SRqqt1FBt/event_proportion"trainer/global_step2:JPœ/{N«bI &Purity/2FRt4SRqqt4FBt/event_proportion"trainer/global_step2:JP¿ò“•H¬bC Purity/3FRt*SRqqt2FBt/FBt_purity"trainer/global_step2:JPy%ÀßH­bC Purity/1FRt3SRqqt2FBt/FRt_purity"trainer/global_step2:JPZXûƒJ®bE "Purity/*FRt2SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPNôbI &Purity/1FRt2SRqqt3FBt/event_proportion"trainer/global_step2:JP$qzJõbE "Purity/2FRt0SRqqt*FBt/event_purity"trainer/global_step2:JPK‚ËNöbI &Purity/2FRt3SRqqt0FBt/event_proportion"trainer/global_step2:JP§ÕÚN÷bI &Purity/4FRt0SRqqt3FBt/event_proportion"trainer/global_step2:JPG2™’;øb6 jet/accuracy_1_of_5"trainer/global_step2:JP’m[JùbE "Purity/0FRt*SRqqt*FBt/event_purity"trainer/global_step2:JP1Ò¤ŸJúbE "Purity/0FRt*SRqqt0FBt/event_purity"trainer/global_step2:JPÂësHûbC Purity/1FRt*SRqqt*FBt/FBt_purity"trainer/global_step2:JP嘼:JübE "Purity/1FRt1SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPÔp 8HýbC Purity/2FRt3SRqqt0FBt/FRt_purity"trainer/global_step2:JP‘4–ÿNþbI &Purity/3FRt3SRqqt3FBt/event_proportion"trainer/global_step2:JPÛÃ}NÿbI &Purity/4FRt1SRqqt*FBt/event_proportion"trainer/global_step2:JP}Ü÷l;€b6 jet/accuracy_3_of_7"trainer/global_step2:JP*„àNbI &Purity/*FRt0SRqqt3FBt/event_proportion"trainer/global_step2:JP¶Š¨ÆH‚bC Purity/2FRt4SRqqt0FBt/FRt_purity"trainer/global_step2:JPó(úïJƒbE "Purity/0FRt3SRqqt1FBt/event_purity"trainer/global_step2:JP°Væ¨H„bC Purity/1FRt4SRqqt0FBt/FRt_purity"trainer/global_step2:JP¯ÔÏjH…bC Purity/0FRt1SRqqt3FBt/FBt_purity"trainer/global_step2:JP˜ÑfH†bC Purity/2FRt2SRqqt2FBt/FRt_purity"trainer/global_step2:JP™äáóJ‡bE "Purity/1FRt1SRqqt0FBt/event_purity"trainer/global_step2:JPz1ž5JˆbE "Purity/2FRt3SRqqt0FBt/event_purity"trainer/global_step2:JPgáBvJ‰bE "Purity/0FRt3SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPÕ Ð—JŠbE "Purity/4FRt1SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPîºÛðH‹bC Purity/1FRt*SRqqt3FBt/FRt_purity"trainer/global_step2:JPÙMõNŒbI &Purity/1FRt*SRqqt4FBt/event_proportion"trainer/global_step2:JPÄ…(ÚJbE "Purity/1FRt0SRqqt2FBt/event_purity"trainer/global_step2:JPxpDJŽbE "Purity/*FRt*SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPؾ>üJbE "Purity/1FRt2SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP–@HbC Purity/2FRt1SRqqt*FBt/FRt_purity"trainer/global_step2:JP0œN‘bI &Purity/4FRt4SRqqt3FBt/event_proportion"trainer/global_step2:JPNªë/@’b; particle/accuracy_2_of_2"trainer/global_step2:JPeäR÷H“bC Purity/*FRt*SRqqt2FBt/FRt_purity"trainer/global_step2:JP’’ó)J”bE "Purity/*FRt0SRqqt*FBt/event_purity"trainer/global_step2:JPV‡H•bC Purity/1FRt0SRqqt1FBt/FRt_purity"trainer/global_step2:JP÷·§ H–bC Purity/1FRt1SRqqt1FBt/FBt_purity"trainer/global_step2:JPÁ±M¶N—bI &Purity/1FRt3SRqqt4FBt/event_proportion"trainer/global_step2:JP»m/`J˜bE "Purity/2FRt4SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP> òH™bC Purity/1FRt*SRqqt4FBt/FBt_purity"trainer/global_step2:JP0{qHšbC Purity/*FRt1SRqqt3FBt/FBt_purity"trainer/global_step2:JPŒð ä@›b; particle/accuracy_6_of_6"trainer/global_step2:JPÌ7hJœbE "Purity/*FRt3SRqqt2FBt/event_purity"trainer/global_step2:JPsl%JbE "Purity/*FRt*SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPƆ#×HžbC Purity/*FRt3SRqqt1FBt/FBt_purity"trainer/global_step2:JPA‹ÕNŸbI &Purity/2FRt2SRqqt*FBt/event_proportion"trainer/global_step2:JPQi)N bI &Purity/4FRt1SRqqt2FBt/event_proportion"trainer/global_step2:JP ’¢<¡b7 particle/specificity"trainer/global_step2:JPÓ‡+^N¢bI &Purity/0FRt*SRqqt3FBt/event_proportion"trainer/global_step2:JPëé,N£bI &Purity/3FRt2SRqqt0FBt/event_proportion"trainer/global_step2:JPZ>ØN¤bI &Purity/4FRt4SRqqt*FBt/event_proportion"trainer/global_step2:JPþ}pä;¥b6 jet/accuracy_2_of_3"trainer/global_step2:JP»ˆì\@¦b; particle/accuracy_1_of_3"trainer/global_step2:JPù ¼¿J§bE "Purity/0FRt1SRqqt0FBt/SRqqt_purity"trainer/global_step2:JP¸@J¨bE "Purity/1FRt*SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP5áP°J©bE "Purity/2FRt*SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPŸ(Ú @ªb; particle/accuracy_1_of_2"trainer/global_step2:JPo0B#J«bE "Purity/3FRt2SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPÈNrH¬bC Purity/3FRt0SRqqt2FBt/FBt_purity"trainer/global_step2:JPZ›†šJ­bE "Purity/4FRt2SRqqt*FBt/event_purity"trainer/global_step2:JPfûJ®bE "Purity/*FRt*SRqqt1FBt/event_purity"trainer/global_step2:JPd ±1H¯bC Purity/0FRt*SRqqt3FBt/FBt_purity"trainer/global_step2:JP·ŽWN°bI &Purity/0FRt2SRqqt0FBt/event_proportion"trainer/global_step2:JP¾¨æ®N±bI &Purity/2FRt*SRqqt4FBt/event_proportion"trainer/global_step2:JP5vugH²bC Purity/2FRt1SRqqt1FBt/FBt_purity"trainer/global_step2:JP Õ N³bI &Purity/2FRt2SRqqt0FBt/event_proportion"trainer/global_step2:JP¿ô? J´bE "Purity/2FRt3SRqqt*FBt/event_purity"trainer/global_step2:JPöZc"NµbI &Purity/3FRt0SRqqt1FBt/event_proportion"trainer/global_step2:JPøÌ¡kN¶bI &Purity/1FRt0SRqqt*FBt/event_proportion"trainer/global_step2:JPÿ¿ÇŠJ·bE "Purity/2FRt1SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPíšâöJ¸bE "Purity/3FRt*SRqqt0FBt/SRqqt_purity"trainer/global_step2:JP²‹›ÓH¹bC Purity/3FRt2SRqqt0FBt/FRt_purity"trainer/global_step2:JP²µWJºbE "Purity/*FRt4SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPÄZUH»bC Purity/0FRt4SRqqt*FBt/FBt_purity"trainer/global_step2:JPÐȹH¼bC Purity/*FRt2SRqqt2FBt/FBt_purity"trainer/global_step2:JP=¥—î@½b; particle/accuracy_6_of_7"trainer/global_step2:JPû_Ô½H¾bC Purity/*FRt0SRqqt0FBt/FRt_purity"trainer/global_step2:JP°¥ÖpN¿bI &Purity/*FRt0SRqqt1FBt/event_proportion"trainer/global_step2:JPè-¥CNÀbI &Purity/0FRt*SRqqt2FBt/event_proportion"trainer/global_step2:JPh|üHÁbC Purity/1FRt*SRqqt1FBt/FRt_purity"trainer/global_step2:JP=K¨"NÂbI &Purity/1FRt0SRqqt0FBt/event_proportion"trainer/global_step2:JP¨š”)NÃbI &Purity/1FRt1SRqqt0FBt/event_proportion"trainer/global_step2:JP}þdLJÄbE "Purity/1FRt1SRqqt3FBt/event_purity"trainer/global_step2:JPý”JÅbE "Purity/*FRt1SRqqt*FBt/event_purity"trainer/global_step2:JPÚ¬xÿJÆbE "Purity/0FRt0SRqqt*FBt/event_purity"trainer/global_step2:JPÆÉÎJÇbE "Purity/0FRt2SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPûÂpNÈbI &Purity/2FRt0SRqqt4FBt/event_proportion"trainer/global_step2:JP/ΦúHÉbC Purity/3FRt1SRqqt1FBt/FBt_purity"trainer/global_step2:JPÁBì×NÊbI &Purity/3FRt4SRqqt*FBt/event_proportion"trainer/global_step2:JP´åÛ}JËbE "Purity/*FRt0SRqqt4FBt/event_purity"trainer/global_step2:JP¤Ÿ÷JÌbE "Purity/0FRt2SRqqt2FBt/event_purity"trainer/global_step2:JPèõ%GNÍbI &Purity/*FRt3SRqqt4FBt/event_proportion"trainer/global_step2:JPLt˜FHÎbC Purity/0FRt*SRqqt*FBt/FBt_purity"trainer/global_step2:JPçsÁHÏbC Purity/1FRt2SRqqt*FBt/FBt_purity"trainer/global_step2:JP-¿¡àJÐbE "Purity/*FRt4SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP+)_ÈHÑbC Purity/0FRt2SRqqt2FBt/FBt_purity"trainer/global_step2:JP©q«èJÒbE "Purity/*FRt1SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP|•=·HÓbC Purity/1FRt3SRqqt*FBt/FBt_purity"trainer/global_step2:JPÉŸNÔbI &Purity/2FRt*SRqqt2FBt/event_proportion"trainer/global_step2:JPÿ—£”HÕbC Purity/2FRt*SRqqt2FBt/FBt_purity"trainer/global_step2:JPGšP-JÖbE "Purity/2FRt1SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP€Y‹ãH×bC Purity/0FRt*SRqqt4FBt/FBt_purity"trainer/global_step2:JPJ2½çHØbC Purity/3FRt4SRqqt*FBt/FRt_purity"trainer/global_step2:JPÚrdìNÙbI &Purity/0FRt1SRqqt2FBt/event_proportion"trainer/global_step2:JPÉ bµNÚbI &Purity/1FRt3SRqqt3FBt/event_proportion"trainer/global_step2:JP/àzNÛbI &Purity/3FRt2SRqqt2FBt/event_proportion"trainer/global_step2:JP©[JÜbE "Purity/2FRt4SRqqt0FBt/event_purity"trainer/global_step2:JPØ™–aJÝbE "Purity/3FRt4SRqqt*FBt/event_purity"trainer/global_step2:JPpÂÑÞ;Þb6 jet/accuracy_1_of_7"trainer/global_step2:JPg²^eJßbE "Purity/1FRt4SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP[t>JàbE "Purity/*FRt*SRqqt4FBt/SRqqt_purity"trainer/global_step2:JP†©ÀHábC Purity/*FRt1SRqqt*FBt/FBt_purity"trainer/global_step2:JP‰[”&NâbI &Purity/0FRt0SRqqt1FBt/event_proportion"trainer/global_step2:JPvüN¶JãbE "Purity/3FRt*SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP¿æÊHäbC Purity/3FRt*SRqqt1FBt/FBt_purity"trainer/global_step2:JPëx¥ÎHåbC Purity/*FRt*SRqqt4FBt/FRt_purity"trainer/global_step2:JPl7ÝÜJæbE "Purity/3FRt3SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPìBâNçbI &Purity/*FRt2SRqqt3FBt/event_proportion"trainer/global_step2:JPë# ŽJèbE "Purity/0FRt0SRqqt0FBt/event_purity"trainer/global_step2:JPœn²®JébE "Purity/2FRt1SRqqt1FBt/event_purity"trainer/global_step2:JP·¸HNêbI &Purity/3FRt1SRqqt2FBt/event_proportion"trainer/global_step2:JP n‹HëbC Purity/2FRt0SRqqt1FBt/FRt_purity"trainer/global_step2:JP­‘€¸NìbI &Purity/3FRt3SRqqt1FBt/event_proportion"trainer/global_step2:JP¸>¦çNíbI &Purity/4FRt0SRqqt0FBt/event_proportion"trainer/global_step2:JPø”JîbE "Purity/*FRt4SRqqt1FBt/event_purity"trainer/global_step2:JPkTekJïbE "Purity/4FRt*SRqqt*FBt/event_purity"trainer/global_step2:JPÆwÖûHðbC Purity/4FRt*SRqqt*FBt/FRt_purity"trainer/global_step2:JPì‚·%NñbI &Purity/*FRt1SRqqt0FBt/event_proportion"trainer/global_step2:JPínÅNòbI &Purity/*FRt*SRqqt4FBt/event_proportion"trainer/global_step2:JP:ò¨]JóbE "Purity/0FRt2SRqqt1FBt/event_purity"trainer/global_step2:JP­ÞqHJôbE "Purity/3FRt0SRqqt1FBt/event_purity"trainer/global_step2:JP°[CNõbI &Purity/4FRt*SRqqt0FBt/event_proportion"trainer/global_step2:JP¿t¯<öb7 particle/sensitivity"trainer/global_step2:JPVÿiH÷bC Purity/*FRt1SRqqt4FBt/FBt_purity"trainer/global_step2:JP0C™ÆHøbC Purity/*FRt1SRqqt3FBt/FRt_purity"trainer/global_step2:JP”óJùbE "Purity/1FRt2SRqqt*FBt/event_purity"trainer/global_step2:JP&'rÙHúbC Purity/2FRt0SRqqt2FBt/FRt_purity"trainer/global_step2:JPÚòJûbE "Purity/*FRt4SRqqt0FBt/event_purity"trainer/global_step2:JP±™kNübI &Purity/0FRt*SRqqt1FBt/event_proportion"trainer/global_step2:JPÖâöoHýbC Purity/0FRt0SRqqt*FBt/FBt_purity"trainer/global_step2:JPû9JNþbI &Purity/0FRt3SRqqt0FBt/event_proportion"trainer/global_step2:JPWîÁxHÿbC Purity/1FRt1SRqqt0FBt/FRt_purity"trainer/global_step2:JP„ßQ)N€ bI &Purity/0FRt4SRqqt1FBt/event_proportion"trainer/global_step2:JP^’Ä@ b; particle/accuracy_4_of_4"trainer/global_step2:JP=Ñ'éH‚ bC Purity/0FRt0SRqqt4FBt/FBt_purity"trainer/global_step2:JP(iïjHƒ bC Purity/1FRt0SRqqt4FBt/FRt_purity"trainer/global_step2:JP¸LfH„ bC Purity/*FRt3SRqqt0FBt/FRt_purity"trainer/global_step2:JP<£ÆN… bI &Purity/0FRt0SRqqt2FBt/event_proportion"trainer/global_step2:JPµížN† bI &Purity/1FRt2SRqqt2FBt/event_proportion"trainer/global_step2:JP(@9©H‡ bC Purity/2FRt*SRqqt*FBt/FRt_purity"trainer/global_step2:JPÙÑÎüJˆ bE "Purity/0FRt4SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP›ÓÐÛJ‰ bE "Purity/4FRt2SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPÒVVNŠ bI &Purity/3FRt2SRqqt4FBt/event_proportion"trainer/global_step2:JPŸò¤ÚN‹ bI &Purity/0FRt2SRqqt1FBt/event_proportion"trainer/global_step2:JP¿¬JŒ bE "Purity/2FRt*SRqqt2FBt/SRqqt_purity"trainer/global_step2:JPíG¸”H bC Purity/2FRt1SRqqt0FBt/FRt_purity"trainer/global_step2:JP?W›¾NŽ bI &Purity/2FRt4SRqqt2FBt/event_proportion"trainer/global_step2:JP74›¦N bI &Purity/3FRt1SRqqt3FBt/event_proportion"trainer/global_step2:JP­#‰@ b; particle/accuracy_3_of_5"trainer/global_step2:JP;xŸ…H‘ bC Purity/3FRt2SRqqt1FBt/FBt_purity"trainer/global_step2:JPyª)äJ’ bE "Purity/3FRt4SRqqt0FBt/SRqqt_purity"trainer/global_step2:JP_Ÿ7«J“ bE "Purity/3FRt1SRqqt2FBt/SRqqt_purity"trainer/global_step2:JPÅ.ÛH” bC Purity/1FRt*SRqqt4FBt/FRt_purity"trainer/global_step2:JP}ÿ=J• bE "Purity/*FRt1SRqqt3FBt/event_purity"trainer/global_step2:JP_-ÙJ– bE "Purity/4FRt2SRqqt0FBt/SRqqt_purity"trainer/global_step2:JPËF³N— bI &Purity/3FRt1SRqqt4FBt/event_proportion"trainer/global_step2:JPĈ¬=H˜ bC Purity/*FRt0SRqqt1FBt/FBt_purity"trainer/global_step2:JPh?kñJ™ bE "Purity/*FRt2SRqqt*FBt/event_purity"trainer/global_step2:JPÍà5=Nš bI &Purity/1FRt2SRqqt0FBt/event_proportion"trainer/global_step2:JPœY†J› bE "Purity/2FRt0SRqqt1FBt/event_purity"trainer/global_step2:JP•UNœ bI &Purity/2FRt3SRqqt1FBt/event_proportion"trainer/global_step2:JPÒà}H bC Purity/2FRt4SRqqt*FBt/FRt_purity"trainer/global_step2:JPÒÉJž bE "Purity/*FRt2SRqqt2FBt/event_purity"trainer/global_step2:JP¨³U¶JŸ bE "Purity/*FRt3SRqqt0FBt/event_purity"trainer/global_step2:JPõvÜJ  bE "Purity/1FRt1SRqqt2FBt/event_purity"trainer/global_step2:JP¨UrHH¡ bC Purity/2FRt3SRqqt*FBt/FRt_purity"trainer/global_step2:JP:ŠäÍJ¢ bE "Purity/0FRt3SRqqt*FBt/event_purity"trainer/global_step2:JPŽ¢AüH£ bC Purity/1FRt4SRqqt*FBt/FRt_purity"trainer/global_step2:JPGˆ-ôJ¤ bE "Purity/0FRt2SRqqt0FBt/SRqqt_purity"trainer/global_step2:JP™v[;¥ b6 jet/accuracy_4_of_5"trainer/global_step2:JP¤¹@¦ b; particle/accuracy_7_of_7"trainer/global_step2:JP,nJ§ bE "Purity/1FRt*SRqqt4FBt/SRqqt_purity"trainer/global_step2:JPåè/¡N¨ bI &Purity/*FRt1SRqqt*FBt/event_proportion"trainer/global_step2:JPο7N© bI &Purity/*FRt4SRqqt*FBt/event_proportion"trainer/global_step2:JPä«Hª bC Purity/1FRt*SRqqt2FBt/FRt_purity"trainer/global_step2:JPäƘRH« bC Purity/2FRt2SRqqt*FBt/FBt_purity"trainer/global_step2:JPÃ0ØBH¬ bC Purity/3FRt1SRqqt0FBt/FRt_purity"trainer/global_step2:JP·0”ÝJ­ bE "Purity/4FRt*SRqqt0FBt/event_purity"trainer/global_step2:JP±ÛŸ"H® bC Purity/4FRt1SRqqt*FBt/FRt_purity"trainer/global_step2:JPk· J¯ bE "Purity/0FRt*SRqqt*FBt/SRqqt_purity"trainer/global_step2:JP,¼{‹J° bE "Purity/0FRt*SRqqt1FBt/SRqqt_purity"trainer/global_step2:JP“<‹ÚN± bI &Purity/1FRt0SRqqt2FBt/event_proportion"trainer/global_step2:JP 4ì•N² bI &Purity/2FRt4SRqqt3FBt/event_proportion"trainer/global_step2:JP«B‚'@³ b; particle/accuracy_3_of_7"trainer/global_step2:JPX~J´ bE "Purity/*FRt2SRqqt3FBt/event_purity"trainer/global_step2:JP1P"QNµ bI &Purity/*FRt2SRqqt1FBt/event_proportion"trainer/global_step2:JPqæwîJ¶ bE "Purity/*FRt3SRqqt1FBt/event_purity"trainer/global_step2:JP… ¹ŽJ· bE "Purity/2FRt1SRqqt2FBt/event_purity"trainer/global_step2:JPò8ˆ+N¸ bI &Purity/3FRt2SRqqt1FBt/event_proportion"trainer/global_step2:JPQÐéJ¹ bE "Purity/*FRt3SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPöÒ@íNº bI &Purity/0FRt4SRqqt4FBt/event_proportion"trainer/global_step2:JPenÓN» bI &Purity/2FRt*SRqqt*FBt/event_proportion"trainer/global_step2:JPfdÓN¼ bI &Purity/2FRt4SRqqt*FBt/event_proportion"trainer/global_step2:JPÌïÒwH½ bC Purity/3FRt0SRqqt*FBt/FRt_purity"trainer/global_step2:JPN±•=N¾ bI &Purity/*FRt0SRqqt2FBt/event_proportion"trainer/global_step2:JP UÜŒJ¿ bE "Purity/0FRt*SRqqt1FBt/event_purity"trainer/global_step2:JP  »HÀ bC Purity/0FRt0SRqqt3FBt/FBt_purity"trainer/global_step2:JP F¯ÀJÁ bE "Purity/0FRt2SRqqt*FBt/event_purity"trainer/global_step2:JPêH™ãN bI &Purity/1FRt2SRqqt1FBt/event_proportion"trainer/global_step2:JPh §Hà bC Purity/3FRt*SRqqt0FBt/FRt_purity"trainer/global_step2:JPøŸÈNÄ bI &Purity/4FRt3SRqqt1FBt/event_proportion"trainer/global_step2:JPùƒqÛHÅ bC Purity/1FRt0SRqqt2FBt/FRt_purity"trainer/global_step2:JP É;Æ b6 loss/val_total_loss"trainer/global_step2:JPè)uHÇ bC Purity/*FRt*SRqqt1FBt/FRt_purity"trainer/global_step2:JPþÍA¿NÈ bI &Purity/*FRt3SRqqt0FBt/event_proportion"trainer/global_step2:JPIºYNÉ bI &Purity/0FRt2SRqqt*FBt/event_proportion"trainer/global_step2:JPØ+æóJÊ bE "Purity/1FRt*SRqqt0FBt/event_purity"trainer/global_step2:JP„ÝÃHNË bI &Purity/1FRt4SRqqt1FBt/event_proportion"trainer/global_step2:JPÙ!@¼NÌ bI &Purity/4FRt4SRqqt2FBt/event_proportion"trainer/global_step2:JP+÷wHÍ bC Purity/*FRt2SRqqt*FBt/FRt_purity"trainer/global_step2:JP¾}ÂKJÎ bE "Purity/0FRt1SRqqt2FBt/event_purity"trainer/global_step2:JP¤m†–@Ï b; particle/accuracy_1_of_4"trainer/global_step2:JP£!;Ð b6 jet/accuracy_3_of_6"trainer/global_step2:JPÁÚ5ÜJÑ bE "Purity/1FRt2SRqqt2FBt/SRqqt_purity"trainer/global_step2:JP%ɉôJÒ bE "Purity/1FRt0SRqqt4FBt/event_purity"trainer/global_step2:JP "fHÓ bC Purity/4FRt2SRqqt0FBt/FRt_purity"trainer/global_step2:JPŸëºaHÔ bC Purity/*FRt0SRqqt3FBt/FRt_purity"trainer/global_step2:JP;ƒÅJÕ bE "Purity/*FRt1SRqqt1FBt/event_purity"trainer/global_step2:JPzÛÀJÖ bE "Purity/*FRt3SRqqt*FBt/SRqqt_purity"trainer/global_step2:JPèaZN× bI &Purity/0FRt*SRqqt*FBt/event_proportion"trainer/global_step2:JP£#F¾JØ bE "Purity/0FRt1SRqqt*FBt/event_purity"trainer/global_step2:JP;kà¢NÙ bI &Purity/2FRt1SRqqt4FBt/event_proportion"trainer/global_step2:JP£zGÎNÚ bI &Purity/3FRt*SRqqt2FBt/event_proportion"trainer/global_step2:JP»þÜÎHÛ bC Purity/*FRt0SRqqt4FBt/FBt_purity"trainer/global_step2:JP(\µjNÜ bI &Purity/*FRt2SRqqt4FBt/event_proportion"trainer/global_step2:JP åB“NÝ bI &Purity/1FRt0SRqqt4FBt/event_proportion"trainer/global_step2:JPHZ7HÞ bC Purity/3FRt2SRqqt*FBt/FBt_purity"trainer/global_step2:JPá)åüJß bE "Purity/3FRt4SRqqt0FBt/event_purity"trainer/global_step2:JP˜'UJà bE "Purity/4FRt2SRqqt0FBt/event_purity"trainer/global_step2:JP;ÐøNá bI &Purity/0FRt1SRqqt3FBt/event_proportion"trainer/global_step2:JPQ”¯Jâ bE "Purity/1FRt3SRqqt1FBt/event_purity"trainer/global_step2:JPåÀ¾¿Jã bE "Purity/2FRt2SRqqt1FBt/SRqqt_purity"trainer/global_step2:JPå•FNä bI &Purity/3FRt2SRqqt3FBt/event_proportion"trainer/global_step2:JPr—ÑINå bI &Purity/3FRt3SRqqt4FBt/event_proportion"trainer/global_step2:JPvà€ÏNæ bI &Purity/4FRt3SRqqt3FBt/event_proportion"trainer/global_step2:JPbäL0ç + _wandbruntime‚673  _runtime‚673á HÔè ¿¥ @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_4_of_4‚1 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 & Purity/1FRt0SRqqt4FBt/FRt_purity‚0 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.16855575144290924 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.12819278240203857 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.1875 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 :"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.37280702590942383 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.1085878536105156 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.25 & Purity/1FRt*SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9957572817802429 <"Purity/*FRt2SRqqt*FBt/event_purity‚0.0037622067611664534 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 ("Purity/2FRt0SRqqt1FBt/event_purity‚0 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.20000000298023224 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.12214285135269165 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.1905442476272583 -jet/accuracy_4_of_5‚0.0029325513169169426 particle/accuracy_7_of_7‚0.5 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚0 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 8 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.26210811734199524 7 Purity/2FRt2SRqqt*FBt/FBt_purity‚0.9821428656578064 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.03611111268401146 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 & Purity/4FRt1SRqqt*FBt/FRt_purity‚0 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.2635498344898224 :"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.33543846011161804 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_7‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.1785714328289032 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.11868686974048615 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6095389127731323 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9055556654930115 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.009965570643544197 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.08965608477592468 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 8 Purity/1FRt0SRqqt2FBt/FRt_µ‹s7ùpurity‚0.25260090827941895 )loss/val_total_loss‚62.30586346536803 6 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.226878359913826 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 ;"Purity/1FRt*SRqqt0FBt/event_purity‚0.026100357994437218 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.1448618769645691 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.012500000186264515 particle/accuracy_1_of_4‚1 jet/accuracy_3_of_6‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.2916666567325592 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 8 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.13333334028720856 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.04643891006708145 :"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.15195788443088531 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.22671113908290863 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 :"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.31458333134651184 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 particle/accuracy_5_of_6‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9844725728034973 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.14506395161151886 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 jet/accuracy_5_of_6‚0 & Purity/2FRt3SRqqt1FBt/FRt_purity‚0 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.21858175098896027 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9941455721855164 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 /"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚0.078125 +jet/accuracy_2_of_6‚0.25438597798347473 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.1518518626689911 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 :"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.37648311257362366 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9582407474517822 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.23729254305362701 jet/accuracy_5_of_7‚0 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.13017047941684723 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9941455721855164 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt0SRqqt*FBt/event_purity‚0 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 :"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.27421659231185913 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 8 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.23076921701431274 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.095238097012043 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.13780438899993896 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.2332286834716797 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.956472635269165 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.15427197515964508 ("Purity/2FRt*SRqqt1FBt/event_purity‚0 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.3390520215034485 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ;"Purity/0FRt2SRqqt0FBt/event_purity‚0.010577140375971794 :"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.32555997371673584 7 Purity/2FRt2SRqqt1FBt/FBt_purity‚0.9821428656578064 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9778459668159485 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.15889406204223633 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 :"Purity/*FRt2SRqqt1FBt/event_purity‚0.00358422938734293 8"Purity/0FRt0SRqqt2FBt/event_purity‚0.289154589176178 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.2568812370300293 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.16981567442417145 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9093255400657654 particle/accuracy_1_of_5‚1 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 :"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.36666667461395264 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.28069111704826355 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.3107134699821472 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9910393953323364 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_6‚1 particle/accuracy_4_of_7‚1 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 +jet/accuracy_2_of_2‚0.06095987930893898 particle/accuracy_1_of_1‚1 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 6 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.972316324710846 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.1436842978000641 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 +"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.25 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.11645501106977463 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9745569825172424 *jet/accuracy_1_of_2‚0.6072766780853271 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3205128312110901 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/1FRt1SRqqt3FBt/FRt_purity‚0 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 jet/accuracy_2_of_7‚0 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.3333333432674408 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9839833378791809 8 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.19083334505558014 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 particle/accuracy_3_of_4‚1 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.23333331942558289 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ("Purity/1FRt*SRqqt3FBt/event_purity‚0 8 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.11106999218463898 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.0833333358168602 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 particle/accuracy_3_of_3‚1 jet/accuracy_4_of_6‚0 *"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.5 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9900230765342712 7 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.9873272180557251 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 :"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.42307692766189575 particle/accuracy_2_of_5‚1 particle/accuracy_1_of_6‚1 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.11488910764455795 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 jet/accuracy_4_of_7‚0 ;"Purity/*FRt*SRqqt3FBt/event_purity‚0.043103449046611786 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 % _timestamp‚1.7884790215841196e+09 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.1705867350101471 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.05000000074505806 jet/accuracy_7_of_7‚0 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.14571607112884521 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.10483607649803162 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 :"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.27822747826576233 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.17575757205486298 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 particle/accuracy_2_of_7‚1 * Purity/0FRt3SRqqt*FBt/FBt_purity‚0.875 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.095238097012043 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.15650945901870728 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9837508201599121 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 +jet/accuracy_3_of_5‚0.03750676289200783 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.0714285746216774 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.14775985479354858 particle/accuracy_4_of_5‚1 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.1975671499967575 8 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.23587681353092194 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.30149656534194946 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.1676243096590042 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 :"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.40789473056793213 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9743274450302124 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.23076923191547394 jet/accuracy_5_of_5‚0 particle/accuracy_2_of_4‚1 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.24386464059352875 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.03798757493495941 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_4_of_4‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.4285714328289032 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9904503226280212 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.08147387206554413 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ("Purity/2FRt*SRqqt2FBt/event_purity‚0 particle/accuracy_2_of_3‚1 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.2820717692375183 :"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.37755104899406433 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.12745311856269836 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.3580247163772583 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.0913885310292244 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.24829109013080597 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.26754388213157654 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.12222222238779068 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 *"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.5 ("Purity/1FRt0SRqqt3FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 _runtime‚ 673.697689567 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9973118901252747 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.23242025077342987 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 particle/accuracy_5_of_7‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9906112551689148 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9849062561988831 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.2420067936182022 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.08678707480430603 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.04717407748103142 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.2222222089767456 (particle/accuracy‚0.8189736008644104 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.0833333358168602 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.0416666679084301 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6374621987342834 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 ("Purity/2FRt*SRqqt0FBt/event_purity‚0 ("Purity/2FRt0SRqqt0FBt/event_purity‚0 & Purity/0FRt2SRqqt3FBt/FBt_purity‚1 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.375 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 particle/accuracy_1_of_7‚1 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.18201754987239838 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.1856141835451126 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.21153846383094788 <"Purity/*FRt2SRqqt0FBt/event_purity‚0.0041043562814593315 :"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.36670437455177307 <"Purity/1FRt1SRqqt*FBt/event_purity‚0.0034434227272868156 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.11477960646152496 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 jet/accuracy_6_of_6‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.008192525245249271 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 'particle/f_score‚0.2977387309074402 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.2373141646385193 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.11211592704057693 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_5_of_5‚1 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.0833333358168602 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.2581983208656311 9"Purity/0FRt*SRqqt3FBt/event_purity‚0.0833333358168602 ;"Purity/1FRt*SRqqt2FBt/event_purity‚0.045158516615629196 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9597722291946411 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 )jet/accuracy_1_of_3‚0.712283730506897 +jet/accuracy_2_of_4‚0.21701614558696747 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.0555555559694767 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.1286439746618271 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 6 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.988723635673523 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 8 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.13333334028720856 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.1785714328289032 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 & Purity/*FRt2SRqqt3FBt/FBt_purity‚1 :"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.21101514995098114 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.1721014529466629 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 6validation_average_jet_accuracy‚0.3292425572872162 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 9 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.059225406497716904 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9699811339378357 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9865591526031494 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 + Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9375 :"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.33082783222198486 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.1473926454782486 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.19748443365097046 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.27354082465171814 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 & Purity/2FRt*SRqqt3FBt/FRt_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚0 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 & Purity/3FRt4SRqqt0FBt/FRt_purity‚0 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.19324757158756256 ("Purity/2FRt*SRqqt*FBt/event_purity‚0 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.12142857164144516 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 6 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.959226131439209 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.12649770081043243 :"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.15063494443893433 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 8"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.523809552192688 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.0446428582072258 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 trainer/global_step‚603 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9815495014190674 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9915322065353394 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 & Purity/4FRt*SRqqt0FBt/FRt_purity‚0 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.0882352963089943 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 +jet/accuracy_1_of_1‚0.35968253016471863 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.07329485565423965 :"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.21790677309036255 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 ,jet/accuracy_3_of_3‚0.008612500503659248 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9057472348213196 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.19644485414028168 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 7 Purity/2FRt*SRqqt1FBt/FBt_purity‚0.9905914068222046 :"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.45000001788139343 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.25 ;"Purity/*FRt0SRqqt0FBt/event_purity‚0.049363262951374054 & Purity/0FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 ("Purity/3FRt*SRqqt*FBt/event_purity‚0 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 jet/accuracy_6_of_7‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.09000000357627869 ;"Purity/1FRt0SRqqt0FBt/event_purity‚0.059225406497716904 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.11583983153104782 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3055555522441864 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_2_of_5‚0.3105904161930084 *jet/accuracy_1_of_6‚0.7894737124443054 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.3058193325996399 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 ("Purity/3FRt*SRqqt1FBt/event_purity‚0 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.12384259700775146 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.20714658498764038 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9479166865348816 *"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.5 epoch‚0 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.14324411749839783 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9746070504188538 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.15555554628372192 ("Purity/2FRt0SRqqt2FBt/event_purity‚0 9"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.1665438413619995 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.18402458727359772 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.09465020895004272 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 & Purity/4FRt1SRqqt0FBt/FRt_purity‚0 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚0 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.28109222650527954 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.14057022333145142 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9774722456932068 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.2083897441625595 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.1195724606513977 9 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.029411764815449715 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.2402447611093521 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 *jet/accuracy_1_of_4‚0.7469677925109863 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.16646824777126312 particle/accuracy_2_of_6‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.14178752899169922 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.1428571492433548 ("Purity/1FRt2SRqqt1FBt/event_purity‚0 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.09322898834943771 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.2813888490200043 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 & Purity/2FRt0SRqqt3FBt/FRt_purity‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 6 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.166463702917099 ,jet/accuracy_3_of_4‚0.022109095007181168 * Purity/0FRt3SRqqt1FBt/FBt_purity‚0.875 _step‚48 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.20239101350307465 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9890643954277039 ;"Purity/1FRt1SRqqt1FBt/event_purity‚0.004017488099634647 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ("Purity/2FRt0SRqqt*FBt/event_purity‚0 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 )jet/accuracy_1_of_5‚0.826137900352478 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.35832178592681885 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.2189694344997406 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9828008413314819 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.3832920789718628 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.1398809552192688 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_3_of_7‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.20000000298023224 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.003561968682333827 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.2291666716337204 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 , Purity/1FRt*SRqqt3FBt/FRt_purity‚0.09375 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.06829365342855453 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.23567800223827362 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.25176650285720825 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.14149656891822815 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.2184954434633255 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.30980852246284485 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.22937732934951782 6 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.983048677444458 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.05000000074505806 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8968254327774048 particle/accuracy_6_of_6‚1 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.3367273807525635 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 +particle/specificity‚0.9250771403312683 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 +jet/accuracy_2_of_3‚0.14997287094593048 particle/accuracy_1_of_3‚1 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.28069111704826355 :"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.37295183539390564 :"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.24164967238903046 particle/accuracy_1_of_2‚1 *"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.5 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.36008551716804504 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8960906267166138 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 7 Purity/2FRt1SRqqt1FBt/FBt_purity‚0.9919354915618896 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.2990177869796753 :"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.18445293605327606 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.1280193328857422 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.0859375 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9385964274406433 particle/accuracy_6_of_7‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.05577467754483223 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.22429056465625763 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.11815348267555237 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.7954335808753967 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.2568740248680115 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9787129163742065 6 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.982666552066803 +"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.25 7 Purity/0FRt2SRqqt2FBt/FBt_purity‚0.9230769276618958 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.3558204174041748 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.3534177839756012 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/3FRt4SRqqt*FBt/FRt_purity‚0 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 jet/accuracy_1_of_7‚0 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.0416666679084301 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚0 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9759460687637329 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 :"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.21212370693683624 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 & Purity/*FRt*SRqqt4FBt/FRt_purity‚0 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.0714285746216774 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 ("P‰CH¸urity/2FRt1SRqqt1FBt/event_purity‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 8 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.24022486805915833 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 & Purity/4FRt*SRqqt*FBt/FRt_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.016129031777381897 ("Purity/3FRt0SRqqt1FBt/event_purity‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 ,particle/sensitivity‚0.24575835466384888 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/*FRt1SRqqt3FBt/FRt_purity‚0 ("Purity/1FRt2SRqqt*FBt/event_purity‚0 8 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.21785715222358704 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 4 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9804727435112 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 7 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.1462346613407135vîãÓ:{é Ã¥ & Purity/0FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 ("Purity/3FRt*SRqqt*FBt/event_purity‚0 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 jet/accuracy_6_of_7‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.09000000357627869 ;"Purity/1FRt0SRqqt0FBt/event_purity‚0.059225406497716904 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.11583983153104782 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3055555522441864 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_2_of_5‚0.3105904161930084 *jet/accuracy_1_of_6‚0.7894737124443054 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.3058193325996399 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 ("Purity/3FRt*SRqqt1FBt/event_purity‚0 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.12384259700775146 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.20714658498764038 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9479166865348816 *"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.5 epoch‚0 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.14324411749839783 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9746070504188538 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.15555554628372192 ("Purity/2FRt0SRqqt2FBt/event_purity‚0 9"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.1665438413619995 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.18402458727359772 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.09465020895004272 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 & Purity/4FRt1SRqqt0FBt/FRt_purity‚0 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚0 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.28109222650527954 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.14057022333145142 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9774722456932068 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.2083897441625595 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.1195724606513977 9 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.029411764815449715 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.2402447611093521 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 *jet/accuracy_1_of_4‚0.7469677925109863 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.16646824777126312 particle/accuracy_2_of_6‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.14178752899169922 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.1428571492433548 ("Purity/1FRt2SRqqt1FBt/event_purity‚0 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.09322898834943771 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.2813888490200043 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 & Purity/2FRt0SRqqt3FBt/FRt_purity‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 6 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.166463702917099 ,jet/accuracy_3_of_4‚0.022109095007181168 * Purity/0FRt3SRqqt1FBt/FBt_purity‚0.875 _step‚48 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.20239101350307465 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9890643954277039 ;"Purity/1FRt1SRqqt1FBt/event_purity‚0.004017488099634647 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ("Purity/2FRt0SRqqt*FBt/event_purity‚0 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 )jet/accuracy_1_of_5‚0.826137900352478 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.35832178592681885 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.2189694344997406 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9828008413314819 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.3832920789718628 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.1398809552192688 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_3_of_7‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.20000000298023224 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.003561968682333827 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.2291666716337204 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 , Purity/1FRt*SRqqt3FBt/FRt_purity‚0.09375 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.06829365342855453 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.23567800223827362 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.25176650285720825 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.14149656891822815 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.2184954434633255 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.30980852246284485 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.22937732934951782 6 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.983048677444458 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.05000000074505806 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8968254327774048 particle/accuracy_6_of_6‚1 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.3367273807525635 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 +particle/specificity‚0.9250771403312683 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 +jet/accuracy_2_of_3‚0.14997287094593048 particle/accuracy_1_of_3‚1 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.28069111704826355 :"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.37295183539390564 :"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.24164967238903046 particle/accuracy_1_of_2‚1 *"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.5 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.36008551716804504 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8960906267166138 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 7 Purity/2FRt1SRqqt1FBt/FBt_purity‚0.9919354915618896 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.2990177869796753 :"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.18445293605327606 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.1280193328857422 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.0859375 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9385964274406433 particle/accuracy_6_of_7‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.05577467754483223 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.22429056465625763 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.11815348267555237 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.7954335808753967 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.2568740248680115 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9787129163742065 6 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.982666552066803 +"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.25 7 Purity/0FRt2SRqqt2FBt/FBt_purity‚0.9230769276618958 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.3558204174041748 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.3534177839756012 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/3FRt4SRqqt*FBt/FRt_purity‚0 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 jet/accuracy_1_of_7‚0 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.0416666679084301 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚0 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9759460687637329 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 :"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.21212370693683624 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 & Purity/*FRt*SRqqt4FBt/FRt_purity‚0 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.0714285746216774 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 8 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.24022486805915833 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 & Purity/4FRt*SRqqt*FBt/FRt_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.016129031777381897 ("Purity/3FRt0SRqqt1FBt/event_purity‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 ,particle/sensitivity‚0.24575835466384888 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/*FRt1SRqqt3FBt/FRt_purity‚0 ("Purity/1FRt2SRqqt*FBt/event_purity‚0 8 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.21785715222358704 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 4 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9804727435112 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 7 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.1462346613407135 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_4_of_4‚1 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 & Purity/1FRt0SRqqt4FBt/FRt_purity‚0 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.16855575144290924 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.12819278240203857 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.1875 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 :"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.37280702590942383 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.1085878536105156 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.25 & Purity/1FRt*SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9957572817802429 <"Purity/*FRt2SRqqt*FBt/event_purity‚0.0037622067611664534 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 ("Purity/2FRt0SRqqt1FBt/event_purity‚0 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.20000000298023224 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.12214285135269165 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.1905442476272583 -jet/accuracy_4_of_5‚0.0029325513169169426 particle/accuracy_7_of_7‚0.5 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚0 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 8 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.26210811734199524 7 Purity/2FRt2SRqqt*FBt/FBt_purity‚0.9821428656578064 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.03611111268401146 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 & Purity/4FRt1SRqqt*FBt/FRt_purity‚0 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.2635498344898224 :"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.33543846011161804 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_7‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.1785714328289032 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.11868686974048615 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6095389127731323 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9055556654930115 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.009965570643544197 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.08965608477592468 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 8 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.25260090827941895 )loss/val_total_loss‚62.30586346536803 6 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.226878359913826 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 ;"Purity/1FRt*SRqqt0FBt/event_purity‚0.026100357994437218 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.1448618769645691 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.012500000186264515 particle/accuracy_1_of_4‚1 jet/accuracy_3_of_6‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.2916666567325592 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 8 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.13333334028720856 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.04643891006708145 :"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.15195788443088531 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.22671113908290863 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 :"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.31458333134651184 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 particle/accuracy_5_of_6‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9844725728034973 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.14506395161151886 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 jet/accuracy_5_of_6‚0 & Purity/2FRt3SRqqt1FBt/FRt_purity‚0 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.21858175098896027 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9941455721855164 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 /"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚0.078125 +jet/accuracy_2_of_6‚0.25438597798347473 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.1518518626689911 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 :"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.37648311257362366 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9582407474517822 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.23729254305362701 jet/accuracy_5_of_7‚0 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.13017047941684723 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9941455721855164 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt0SRqqt*FBt/event_purity‚0 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 :"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.27421659231185913 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 8 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.23076921701431274 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.095238097012043 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.13780438899993896 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.2332286834716797 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.956472635269165 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.15427197515964508 ("Purity/2FRt*SRqqt1FBt/event_purity‚0 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.3390520215034485 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ;"Purity/0FRt2SRqqt0FBt/event_purity‚0.010577140375971794 :"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.32555997371673584 7 Purity/2FRt2SRqqt1FBt/FBt_purity‚0.9821428656578064 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9778459668159485 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.15889406204223633 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 :"Purity/*FRt2SRqqt1FBt/event_purity‚0.00358422938734293 8"Purity/0FRt0SRqqt2FBt/event_purity‚0.289154589176178 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.2568812370300293 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.16981567442417145 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9093255400657654 particle/accuracy_1_of_5‚1 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 :"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.36666667461395264 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.28069111704826355 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.3107134699821472 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9910393953323364 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_6‚1 particle/accuracy_4_of_7‚1 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 +jet/accuracy_2_of_2‚0.06095987930893898 particle/accuracy_1_of_1‚1 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 6 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.972316324710846 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.1436842978000641 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 +"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.25 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.11645501106977463 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9745569825172424 *jet/accuracy_1_of_2‚0.6072766780853271 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3205128312110901 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/1FRt1SRqqt3FBt/FRt_purity‚0 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 jet/accuracy_2_of_7‚0 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.3333333432674408 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9839833378791809 8 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.19083334505558014 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 particle/accuracy_3_of_4‚1 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.23333331942558289 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ("Purity/1FRt*SRqqt3FBt/event_purity‚0 8 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.11106999218463898 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.0833333358168602 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 particle/accuracy_3_of_3‚1 jet/accuracy_4_of_6‚0 *"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.5 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9900230765342712 7 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.9873272180557251 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 :"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.42307692766189575 particle/accuracy_2_of_5‚1 particle/accuracy_1_of_6‚1 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.11488910764455795 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 jet/accuracy_4_of_7‚0 ;"Purity/*FRt*SRqqt3FBt/event_purity‚0.043103449046611786 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 % _timestamp‚1.7884790215841196e+09 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.1705867350101471 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.05000000074505806 jet/accuracy_7_of_7‚0 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.14571607112884521 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.10483607649803162 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 :"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.27822747826576233 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.17575757205486298 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 particle/accuracy_2_of_7‚1 * Purity/0FRt3SRqqt*FBt/FBt_purity‚0.875 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.095238097012043 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.15650945901870728 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9837508201599121 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 +jet/accuracy_3_of_5‚0.03750676289200783 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.0714285746216774 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.14775985479354858 particle/accuracy_4_of_5‚1 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.1975671499967575 8 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.23587681353092194 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.30149656534194946 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.1676243096590042 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 :"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.40789473056793213 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9743274450302124 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.23076923191547394 jet/accuracy_5_of_5‚0 particle/accuracy_2_of_4‚1 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.24386464059352875 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.03798757493495941 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_4_of_4‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.4285714328289032 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9904503226280212 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.08147387206554413 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ("Purity/2FRt*SRqqt2FBt/event_purity‚0 particle/accuracy_2_of_3‚1 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.2820717692375183 :"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.37755104899406433 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.12745311856269836 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.3580247163772583 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.0913885310292244 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.24829109013080597 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.26754388213157654 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.12222222238779068 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 *"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.5 ("Purity/1FRt0SRqqt3FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 _runtime‚ 673.697689567 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9973118901252747 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.23242025077342987 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 particle/accuracy_5_of_7‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9906112551689148 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9849062561988831 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.2420067936182022 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.08678707480430603 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.04717407748103142 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.2222222089767456 (particle/accuracy‚0.8189736008644104 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.0833333358168602 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.0416666679084301 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6374621987342834 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 ("Purity/2FRt*SRqqt0FBt/event_purity‚0 ("Purity/2FRt0SRqqt0FBt/event_purity‚0 & Purity/0FRt2SRqqt3FBt/FBt_purity‚1 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.375 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 particle/accuracy_1_of_7‚1 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.18201754987239838 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.1856141835451126 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.21153846383094788 <"Purity/*FRt2SRqqt0FBt/event_purity‚0.0041043562814593315 :"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.3667043745517730fÊÙ\7 <"Purity/1FRt1SRqqt*FBt/event_purity‚0.0034434227272868156 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.11477960646152496 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 jet/accuracy_6_of_6‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.008192525245249271 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 'particle/f_score‚0.2977387309074402 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.2373141646385193 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.11211592704057693 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_5_of_5‚1 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.0833333358168602 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.2581983208656311 9"Purity/0FRt*SRqqt3FBt/event_purity‚0.0833333358168602 ;"Purity/1FRt*SRqqt2FBt/event_purity‚0.045158516615629196 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9597722291946411 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 )jet/accuracy_1_of_3‚0.712283730506897 +jet/accuracy_2_of_4‚0.21701614558696747 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.0555555559694767 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.1286439746618271 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 6 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.988723635673523 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 8 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.13333334028720856 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.1785714328289032 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 & Purity/*FRt2SRqqt3FBt/FBt_purity‚1 :"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.21101514995098114 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.1721014529466629 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 6validation_average_jet_accuracy‚0.3292425572872162 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 9 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.059225406497716904 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9699811339378357 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9865591526031494 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 + Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9375 :"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.33082783222198486 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.1473926454782486 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.19748443365097046 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.27354082465171814 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 & Purity/2FRt*SRqqt3FBt/FRt_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚0 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 & Purity/3FRt4SRqqt0FBt/FRt_purity‚0 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.19324757158756256 ("Purity/2FRt*SRqqt*FBt/event_purity‚0 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.12142857164144516 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 6 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.959226131439209 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.12649770081043243 :"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.15063494443893433 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 8"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.523809552192688 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.0446428582072258 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 trainer/global_step‚603 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9815495014190674 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9915322065353394 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 & Purity/4FRt*SRqqt0FBt/FRt_purity‚0 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.0882352963089943 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 +jet/accuracy_1_of_1‚0.35968253016471863 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.07329485565423965 :"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.21790677309036255 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 ,jet/accuracy_3_of_3‚0.008612500503659248 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9057472348213196 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.19644485414028168 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 7 Purity/2FRt*SRqqt1FBt/FBt_purity‚0.9905914068222046 :"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.45000001788139343 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.25 ;"Purity/*FRt0SRqqt0FBt/event_purity‚0.0493632629513740540y±©u‘ê ‚(:† ®ŒèÔÞÏש gpu.0.gpu‚6.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚34.0 gpu.0.powerWatts‚86.502' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚21.6255 gpu.0.smClock‚1155 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0M[LWTë ‚(:É ®ŒèÔ–€©« disk.sda.in‚ 53.67578125 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚ 8.8046875 disk.md0.in‚ 62.48046875 disk.dm-0.out‚ 6692.66796875 network.sent‚861006$ memory_percent‚57.46951103210449" proc.memory.rssMB‚ 3558.6796875 disk.sda1.out‚0 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 75.95703125% disk./.usageGB‚2974.8568420410156 disk.nvme0n1.in‚0 disk.rbd0.in‚0 disk.sdb1.in‚0( proc.memory.availableMB‚ 6968.1953125 network.recv‚307203" disk.nvme0n1.out‚ 2938.30078125 disk.rbd0.out‚ 0.01171875* proc.memory.percent‚21.720457077026367 cpu‚25.536789073155397 proc.cpu.threads‚17 disk.sda.out‚ 78.7060546875! disk.nvme1n1.out‚ 3754.3671875 disk.sdb2.out‚ 78.7060546875 disk.sda2.out‚ 78.7060546875 disk.rbd2.in‚0 disk.rbd2.out‚ 0.01171875 disk.sdb1.out‚0 disk.sdb.out‚ 78.7060546875 disk.md0.out‚ 75.95703125 disk.sdb.in‚ 8.8046875 disk.sda2.in‚ 53.67578125 disk.dm-0.in‚ 32.45703125) disk./.usagePercent‚83.17824237778238¸Éû%žì ‚(:“ ½ŒèÔ²†’ª gpu.0.gpu‚83.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚242.89' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚60.722500000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0evðùRí ‚(:Ç ½ŒèÔùÿ—«# proc.memory.rssMB‚ 3164.44140625 disk.sda2.in‚ 53.67578125 disk.md0.out‚ 77.12890625 disk.md0p1.out‚ 77.12890625 disk.nvme0n1.in‚0 disk.nvme0n1.out‚ 4187.765625 network.recv‚313004 disk.dm-0.in‚ 32.45703125 disk.sda1.out‚0 disk.sda2.out‚79.94482421875 disk.sdb1.out‚0) proc.memory.availableMB‚ 6230.35546875 network.sent‚963313 disk.md0.in‚ 62.48046875 disk.rbd0.out‚ 0.07421875 disk.sdb.in‚ 8.8046875 disk.sdb2.out‚79.94482421875 cpu‚25.53362955605601% disk./.usageGB‚2975.9620056152344 disk.md0p1.in‚ 62.48046875 disk.sda.in‚ 53.67578125 disk.sda.out‚79.94482421875 disk.nvme1n1.in‚ 32.45703125 disk.nvme1n1.out‚3757.125 disk.sdb.out‚79.94482421875* proc.memory.percent‚19.314217567443848) disk./.usagePercent‚83.20914321386444% memory_percent‚61.972928047180176 disk.dm-0.out‚ 7944.890625 disk.rbd2.out‚ 0.01171875 disk.sdb1.in‚0 proc.cpu.threads‚17 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sda1.in‚0 disk.sdb2.in‚ 8.8046875Ôzó”î ‚(:‰ ÌŒèÔ˯ҩ gpu.0.gpu‚29.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚206.943' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.73575 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0rû›Tï ‚(:É ÌŒèÔ”ÿÕª disk.sdb1.out‚0( proc.memory.availableMB‚ 6230.3515625 disk.sda.out‚82.08056640625" disk.nvme0n1.out‚ 4331.85546875 disk.sdb.in‚ 8.8046875 disk.md0.in‚ 62.48046875 disk.md0.out‚ 79.203125 disk.rbd0.out‚ 0.07421875 cpu‚25.533997244649033 proc.cpu.threads‚17) disk./.usagePercent‚83.21264743898676$ disk./.usageGB‚2976.087333679199 disk.sda2.in‚ 53.67578125 disk.rbd2.out‚ 0.07421875 disk.sdb2.in‚ 8.8046875 disk.dm-0.in‚ 32.45703125 disk.dm-0.out‚ 8117.953125% memory_percent‚61.972951889038086 network.sent‚968518 disk.nvme0n1.in‚0 disk.sdb.out‚82.08056640625* proc.memory.percent‚19.314217567443848 disk.rbd2.in‚0 disk.sda1.out‚0 disk.md0p1.in‚ 62.48046875 disk.sda1.in‚0 disk.md0p1.out‚ 79.203125 disk.rbd0.in‚0 network.recv‚316881 disk.sdb2.out‚82.08056640625 disk.sda2.out‚82.08056640625# proc.memory.rssMB‚ 3164.44140625 disk.sda.in‚ 53.67578125 disk.nvme1n1.in‚ 32.45703125" disk.nvme1n1.out‚ 3786.09765625 disk.sdb1.in‚0ÎК¼žð ‚(:“ ÛŒèÔŒ°Á© gpu.0.gpu‚68.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚205.109' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚51.27725000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0F®'DXñ ‚(:Í ÛŒèÔ–¹áª disk.sda.in‚ 53.67578125 disk.md0p1.in‚ 62.48046875 disk.rbd0.out‚ 0.1533203125 disk.dm-0.in‚ 32.45703125 disk.rbd2.out‚ 0.07421875 disk.sdb1.out‚0 network.sent‚977234 network.recv‚321620 disk.sda1.in‚0 disk.sda2.out‚83.59033203125 disk.sdb1.in‚0* proc.memory.percent‚19.314217567443848 proc.cpu.threads‚17) disk./.usagePercent‚83.21613161192904 disk.sda.out‚83.59033203125 disk.sdb.in‚ 8.8046875 disk.md0.out‚ 80.6640625 disk.rbd0.in‚0 disk.dm-0.out‚ 8324.68359375 cpu‚25.53265572254165 disk.sda1.out‚0" disk.nvme0n1.out‚ 4432.23046875 disk.sdb2.out‚83.59033203125$ disk./.usageGB‚2976.211944580078 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 53.67578125% memory_percent‚61.972880363464355 disk.nvme0n1.in‚0 disk.nvme1n1.out‚ 3892.453125 disk.sdb.out‚83.59033203125 disk.sdb2.in‚ 8.8046875) proc.memory.availableMB‚ 6230.36328125# proc.memory.rssMB‚ 3164.44140625 disk.md0.in‚ 62.48046875 disk.md0p1.out‚ 80.6640625 disk.rbd2.in‚04 `q0ò + _wandbruntime‚723  _runtime‚723=CjÄó ¾ _step‚49 & lr-AdamW/pg1‚0.0011960254920433768 & lr-AdamW/pg2‚0.0011960254920433768 trainer/global_step‚649 % _timestamp‚1.7884790714782848e+09 _runtime‚ 723.588791369Ðr¡Èô  & lr-AdamW/pg2‚0.0011960254920433768 trainer/global_step‚649 % _timestamp‚1.7884790714782848e+09 _runtime‚ 723.588791369 _step‚49 & lr-AdamW/pg1‚0.00119602549204337681N–~´0õ + _wandbruntime‚723  _runtime‚723MkrUÏ'ö ÉO G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚89147271296000 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 713058356224 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚26184478 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 710664800813 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚89147288335360 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚3387951 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚509 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚89861130167296 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚89860329652224 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚88340486281245 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚26161206 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚11765908 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚76603563998208 % _timestamp‚1.7884790714800484e+09 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚11765910 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚77377567339520 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚3388460 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 trainer/global_step‚649 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 713841831936 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚11765908 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚10705801 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚14395298 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚14418568 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 773978437632 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 B p™&÷ ÍO H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚14418568 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 773978437632 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚89147271296000 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 713058356224 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚26184478 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 710664800813 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚89147288335360 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚3387951 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚509 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚89861130167296 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚89860329652224 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚88340486281245 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚26161206 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚11765908 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚76603563998208 % _timestamp‚1.7884790714800484e+09 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚11765910 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚77377567339520 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚3388460 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 trainer/global_step‚649 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 713841831936 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 G°À:ADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚11765908 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚10705801 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚143952982¼ÿâŠ0ø + _wandbruntime‚724  _runtime‚724¿åŒ(Ù&ù ÓM ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚87760488720832 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚11783360 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚89280022607872 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚507 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183035904 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 775128115712 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 % _timestamp‚1.7884790724872873e+09 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 714124695040 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚10721944 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 714124695040 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚76717732704768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚89280039647232 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚14416986 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚76717707801088 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚89994947831296 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚7328610 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚14440282 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 714908184064 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚26223644 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 trainer/global_step‚649 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 714908184064 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚89994947831296 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚77492677784576 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚89994147302912 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚87760471681472 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 712509028223 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚26200346 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚14440282 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚11783362 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3393331 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚11783362 ODeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚26223644 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚510 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 _step‚51 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚89280022607872 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚89280039647232 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158132224 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚10721434 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0v¬-4Ý&ú ×M [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 714908184064 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚26223644 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 trainer/global_step‚649 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 714908184064 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚89994947831296 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚77492677784576 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚89994147302912 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 YFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚87760471681472 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 712509028223 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚26200346 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚14440282 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚11783362 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3393331 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚11783362 ODeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚26223644 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚510 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 _step‚51 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚89280022607872 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚89280039647232 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158132224 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚10721434 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ]JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚87760488720832 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚11783360 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚89280022607872 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚507 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183035904 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 775128115712 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 % _timestamp‚1.7884790724872873e+09 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 714124695040 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚10721944 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 714124695040 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚76717732704768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 ZGDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚89280039647232 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚14416986 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚76717707801088 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚89994947831296 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚7328610 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚144402823âi10û + _wandbruntime‚724  _runtime‚724Ï®‹¦Oü É 0loss/FBt4/assignment_loss‚0.6870333223172929 .loss/FBt2/detection_loss‚3.947038491566976 /loss/FBt4/detection_loss‚2.3958822298049927 1loss/SRqqt2/assignment_loss‚2.036365793039233 2loss/SRqqt3/assignment_loss‚2.3368605242608345 1loss/FBt1/assignment_loss‚0.18465302721809554 0loss/FBt2/assignment_loss‚0.6284182709124353 .loss/FRt2/detection_loss‚2.388846279609771 $loss/total_loss‚55.8552447755231 _step‚52 trainer/global_step‚649 .loss/FRt4/assignment_loss‚5.41287239230409 2loss/SRqqt1/assignment_loss‚1.4308151494151626 /loss/FRt4/detection_loss‚2.3391879608436508 0loss/SRqqt1/detection_loss‚1.060552524195777 _runtime‚ 724.600511892 2loss/SRqqt4/assignment_loss‚2.5150154745578766 /loss/FRt1/detection_loss‚1.9619157352838024 1loss/SRqqt3/detection_loss‚2.3032072439585645 epoch‚1 % _timestamp‚1.7884790724895775e+09 /loss/FRt2/assignment_loss‚4.472415826150349 .loss/FRt3/detection_loss‚3.038768768310547 .loss/FBt1/detection_loss‚0.777173794181404 0loss/FRt1/assignment_loss‚2.5898658741137077 .loss/FRt3/assignment_loss‚5.14704849101879 0loss/FBt3/assignment_loss‚0.2652568267235024 1loss/SRqqt4/detection_loss‚2.9647740173339843 -loss/FBt3/detection_loss‚3.07777479020032 1loss/SRqqt2/detection_loss‚1.8935019682019443–Õ°Sý Í /loss/FRt4/detection_loss‚2.3391879608436508 0loss/SRqqt1/detection_loss‚1.060552524195777 _runtime‚ 724.600511892 2loss/SRqqt4/assignment_loss‚2.5150154745578766 /loss/FRt1/detection_loss‚1.9619157352838024 1loss/SRqqt3/detection_loss‚2.3032072439585645 epoch‚1 % _timestamp‚1.7884790724895775e+09 /loss/FRt2/assignment_loss‚4.472415826150349 .loss/FRt3/detection_loss‚3.038768768310547 .loss/FBt1/detection_loss‚0.777173794181404 0loss/FRt1/assignment_loss‚2.5898658741137077 .loss/FRt3/assignment_loss‚5.14704849101879 0loss/FBt3/assignment_loss‚0.2652568267235024 1loss/SRqqt4/detection_loss‚2.9647740173339843 -loss/FBt3/detection_loss‚3.07777479020032 1loss/SRqqt2/detection_loss‚1.8935019682019443 0loss/FBt4/assignment_loss‚0.6870333223172929 .loss/FBt2/detection_loss‚3.947038491566976 /loss/FBt4/detection_loss‚2.3958822298049927 1loss/SRqqt2/assignment_loss‚2.036365793039233 2loss/SRqqt3/assignment_loss‚2.3368605242608345 1loss/FBt1/assignment_loss‚0.18465302721809554 0loss/FBt2/assignment_loss‚0.6284182709124353 .loss/FRt2/detection_loss‚2.388846279609771 $loss/total_loss‚55.8552447755231 _step‚52 trainer/global_step‚649 .loss/FRt4/assignment_loss‚5.41287239230409 2loss/SRqqt1/assignment_loss‚1.43081514941516264Ôež’þ ‚(:‡ êŒèÔ’ÿ­ gpu.0.gpu‚14.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚130.564' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚32.641 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0hVé4Uÿ ‚(:Ê êŒèÔù÷¤® disk.sdb1.in‚0 disk.sdb2.in‚ 8.8046875( proc.memory.availableMB‚ 6230.5546875 disk.md0.in‚ 62.48046875 disk.md0p1.out‚ 82.11328125 network.sent‚980354 disk.rbd2.in‚0 disk.sda.in‚ 53.67578125 disk.md0p1.in‚ 62.48046875 network.recv‚325563 disk.dm-0.in‚ 32.45703125 disk.sda1.out‚0 disk.nvme0n1.in‚0 disk.sda2.out‚ 85.1005859375 disk.rbd0.out‚ 0.1533203125) disk./.usagePercent‚83.22315019492426$ disk./.usageGB‚2976.462963104248 disk.dm-0.out‚ 8465.02734375 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 53.67578125 disk.md0.out‚ 82.11328125 cpu‚25.53210204471403 proc.cpu.threads‚17 disk.sda.out‚ 85.1005859375 disk.nvme0n1.out‚ 4476.21875" disk.nvme1n1.out‚ 3988.80859375 disk.sdb.in‚ 8.8046875 disk.sdb.out‚ 85.1005859375 disk.sda1.in‚0 disk.sdb1.out‚0 disk.rbd0.in‚0# proc.memory.rssMB‚ 3164.44140625* proc.memory.percent‚19.314217567443848 disk.rbd2.out‚ 0.1533203125 disk.sdb2.out‚ 85.1005859375$ memory_percent‚61.97171211242676ñŸ›—•€ ‚(:Š ùŒèÔ³öÜ« gpu.0.gpu‚75.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚212.507' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.12675 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0v{šW ‚(:Ì ùŒèÔÚ™ù¬ disk.rbd2.out‚ 0.1533203125$ memory_percent‚61.97493076324463) proc.memory.availableMB‚ 6230.02734375 disk.sdb.in‚ 8.8046875 disk.md0p1.out‚ 83.9609375 disk.dm-0.out‚ 8695.984375 cpu‚25.530308604725324 disk.sdb2.in‚ 8.8046875* proc.memory.percent‚19.314217567443848 disk.sda.out‚ 87.0244140625 disk.sda1.in‚0 disk.nvme0n1.in‚0 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sdb1.out‚0# proc.memory.rssMB‚ 3164.44140625 disk.nvme0n1.out‚ 4620.421875 disk.nvme1n1.out‚ 4075.5625 disk.sdb.out‚ 87.0244140625 disk.sda2.in‚ 53.67578125 disk.md0.in‚ 62.48046875 disk.md0.out‚ 83.9609375) disk./.usagePercent‚83.22312171656218 disk.sda1.out‚0 proc.cpu.threads‚17 network.sent‚ 1.069311e+06 network.recv‚331685 disk.sda.in‚ 53.67578125 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.out‚ 87.0244140625 disk.dm-0.in‚ 32.45703125 disk.sdb1.in‚0$ disk./.usageGB‚2976.461944580078 disk.md0p1.in‚ 62.48046875 disk.sda2.out‚ 87.0244140625 disk.rbd0.out‚ 0.21630859375d¥6•‚ ‚(:Š ˆèÔ§Žâ« gpu.0.gpu‚59.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0XF/^ƒ ‚(:Ó ˆèÔ‰“ˆ¬ disk.sdb2.in‚ 8.8046875 disk.sda2.out‚ 88.6181640625 disk.md0.in‚ 62.48046875 disk.sda1.in‚0 cpu‚25.528552776006585 network.sent‚ 1.072341e+06$ disk./.usageGB‚2976.461944580078 disk.rbd2.out‚ 0.21630859375! disk.nvme0n1.out‚ 4764.5859375 disk.sdb1.in‚0! disk.nvme1n1.out‚ 4191.0859375 network.recv‚335340 disk.dm-0.out‚ 8955.671875 disk.rbd2.in‚0$ memory_percent‚61.97865009307861# proc.memory.rssMB‚ 3164.44140625 disk.rbd0.out‚ 0.21630859375 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125) proc.memory.availableMB‚ 6229.41796875 proc.cpu.threads‚17 disk.sdb.in‚ 8.8046875 disk.sda2.in‚ 53.67578125 disk.sdb1.out‚0 disk.sda.out‚ 88.6181640625* proc.memory.percent‚19.314217567443848 disk.md0.out‚ 85.50390625 disk.md0p1.in‚ 62.48046875 disk.md0p1.out‚ 85.50390625 disk.rbd0.in‚0 disk.nvme0n1.in‚0) disk./.usagePercent‚83.22312171656218 disk.sdb.out‚ 88.6181640625 disk.sdb2.out‚ 88.6181640625 disk.dm-0.in‚ 32.45703125 disk.sda.in‚ 53.67578125Ÿ˜q0„ + _wandbruntime‚779  _runtime‚779×hÇÙÃ… ½ trainer/global_step‚699 $ _timestamp‚1.788479127120181e+09 _runtime‚ 779.230545017 _step‚53 & lr-AdamW/pg1‚0.0011953265209854857 & lr-AdamW/pg2‚0.0011953265209854857ôÚ߶dž Á _step‚53 & lr-AdamW/pg1‚0.0011953265209854857 & lr-AdamW/pg2‚0.0011953265209854857 trainer/global_step‚699 $ _timestamp‚1.788479127120181e+09 _runtime‚ 779.2305450175j¥Ê0‡ + _wandbruntime‚779  _runtime‚779=¼ààˆ ÉO TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚15506320 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚15483050 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 _runtime‚ 779.232364535 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚96552040529920 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚7855853 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚83142599934464 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚94926160771553 _step‚54 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚82310779045888 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚12638510 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚82310754142208 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚12638508 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚95784853928960 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚28144830 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 767186600960 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚11492492 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚28121558 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚96551240014848 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 831820888576 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚11491994 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚95784836889600 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 766403125248=:ÏùÓ'‰ ÍO [HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚95784836889600 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 766403125248 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚15506320 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚15483050 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 _runtime‚ 779.232364535 XEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚96552040529920 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚7855853 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚83142599934464 TADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚94926160771553 _step‚54 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚82310779045888 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚12638510 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚82310754142208 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚12638508 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 \IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚95784853928960 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚28144830 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 767186600960 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚11492492 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚28121558 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 Q>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚96551240014848 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 831820888576 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚11491994 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚170393606‚ϵ•Š ‚(:Š —èÔ³¾»ª gpu.0.gpu‚53.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚231.089' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.77225 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 çŸLV‹ ‚(:Ë —èÔƒõ¬­ disk.sdb1.in‚0 network.sent‚ 1.091572e+06 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.8046875 disk.sda2.in‚ 53.67578125 disk.dm-0.out‚ 9186.5703125 disk.sda1.out‚0 cpu‚25.527635928599345 network.recv‚339867 disk.rbd0.in‚0 disk.sda.out‚ 90.1728515625 proc.cpu.threads‚17 disk.sda2.out‚ 90.1728515625$ disk./.usageGB‚2976.461944580078 disk.md0p1.out‚ 87.015625 disk.rbd2.out‚ 0.21630859375# proc.memory.rssMB‚ 3164.44140625* proc.memory.percent‚19.314217567443848 disk.sdb.out‚ 90.1728515625 disk.md0.out‚ 87.015625 disk.rbd2.in‚0 disk.nvme0n1.out‚ 4908.65625 disk.rbd0.out‚ 0.279296875 disk.dm-0.in‚ 32.45703125( proc.memory.availableMB‚ 6227.9765625 disk.nvme0n1.in‚0 disk.sdb2.out‚ 90.1728515625 disk.md0.in‚ 62.48046875 disk.sda1.in‚0) disk./.usagePercent‚83.22312171656218! disk.nvme1n1.out‚ 4277.9140625 disk.md0p1.in‚ 62.48046875 disk.sda.in‚ 53.67578125$ memory_percent‚61.98744773864746 disk.sdb2.in‚ 8.8046875 disk.sdb1.out‚0ø¦*Ð0Œ + _wandbruntime‚780  _runtime‚780á/R.Ù& ÓM ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 S@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚96685858193920 % _timestamp‚1.7884791280721877e+09 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 832959144960 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 166520832 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚12655960 ^KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚82424897945088 VCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚96685858193920 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 764891984447 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚7866613 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 768252953088 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚28183996 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚11508179 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚96685057665536 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚95917588201472 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚12655962 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚12655960 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚7866610 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚83257881993728 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚11507651 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚12655962 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚95057873717919 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 trainer/global_step‚699 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 768252953088 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚528 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚15528034 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 767469464064 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _step‚55 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚15528034 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚95058672239363 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3641566 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚28160698 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚15504738 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 767469464064 _runtime‚ 780.183015467 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚28183996 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚28160698 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚3641041 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚95917605240832 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚95917588201472 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚15504738 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚15528034 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 767469464064 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _step‚55 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚15528034 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 VCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚95058672239363 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3641566 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚28160698 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚15504738 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 767469464064 _runtime‚ 780.183015467 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚28183996 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚28160698 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚3641041 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ]JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚95917605240832 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 VCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚95917588201472 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚15504738 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.fre«¸xLÄed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 768252953088 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚28183996 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚11508179 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 R?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚96685057665536 YFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚95917588201472 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚12655962 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚12655960 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚7866610 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚83257881993728 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚11507651 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚12655962 R?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚95057873717919 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 trainer/global_step‚699 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 768252953088 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚528 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 Fž– ‚(:“ ÄèÔ–ÙÄ« gpu.0.gpu‚85.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚204.769' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚51.19225000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ÿ»"J— ‚(:¿ ÄèÔÀ½Þ« network.sent‚ 1.236615e+06 disk.nvme0n1.in‚0 disk.rbd0.in‚0 disk.dm-0.out‚ 9654.28515625 disk.sda1.in‚0) proc.memory.availableMB‚ 6227.47265625 disk.sdb1.out‚0( disk./.usagePercent‚83.2069787516861" disk.nvme0n1.out‚ 5268.98828125 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚ 8.8046875 disk.rbd0.out‚ 0.279296875 disk.nvme1n1.out‚ 4385.296875 disk.md0.in‚ 62.48046875 disk.md0.out‚ 91.79296875 disk.dm-0.in‚ 32.45703125 disk.sda.out‚ 95.140625 disk.sda1.out‚0" proc.memory.rssMB‚ 3164.4453125* proc.memory.percent‚19.314241409301758 proc.cpu.threads‚17 disk.sdb1.in‚0 network.recv‚353501$ disk./.usageGB‚2975.884593963623 disk.rbd2.in‚0$ memory_percent‚61.99052333831787 disk.rbd2.out‚ 0.279296875 disk.sdb.in‚ 8.8046875 disk.sdb.out‚ 95.140625 disk.sda2.in‚ 53.67578125 disk.md0p1.in‚ 62.48046875 cpu‚25.524841368177555 disk.sdb2.out‚ 95.140625 disk.sda2.out‚ 95.140625 disk.md0p1.out‚ 91.79296875 disk.sda.in‚ 53.67578125EÉïƒ0˜ + _wandbruntime‚832  _runtime‚832Ë08ÙÄ™ ¾ & lr-AdamW/pg1‚0.0011941289185138475 & lr-AdamW/pg2‚0.0011941289185138475 trainer/global_step‚749 % _timestamp‚1.7884791805589883e+09 _runtime‚ 832.669182718 _step‚57\SÔ~Èš  _runtime‚ 832.669182718 _step‚57 & lr-AdamW/pg1‚0.0011941289185138475 & lr-AdamW/pg2‚0.0011941289185138475 trainer/global_step‚749 % _timestamp‚1.7884791805589883e+099êÔd80› + _wandbruntime‚832  _runtime‚832³tÌËÛ'œ ÕO M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚30105182 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚8393853 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚101511835261861 _runtime‚ 832.673828909 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚88907599259136 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚88017969189888 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚102422419522560 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚16570802 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚8393850 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚103242950892544 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 889654972928 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚100694841584432 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚16594072 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚12280726 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚101512633783097 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚103242150377472 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚102422402483200 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚88017944286208 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚3886876 trainer/global_step‚749 _step‚58 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 817775159305 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚102422419522560 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚100694858623792 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚16594072 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚12281255 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 819747894272 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 820531369984 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 % _timestamp‚1.7884791805596857e+09 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚88907776016896 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 819747894272 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 889806827008 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151854080 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚103242150377472 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚102422402483200 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚88017944286208 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚3886876 trainer/global_step‚749 _step‚58 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 817775159305 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚102422419522560 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚100694858623792 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚16594072 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚12281255 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 819747894272 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 820531369984 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 % _timestamp‚1.7884791805596857e+09 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚88907776016896 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 819747894272 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 889806827008 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151854080 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 IDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚13528560 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚3891851 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚30144348 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚8404610 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚12296980 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 818837904839 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 890970903040 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 821597722112 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚16615786 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚89023083895808 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚103375968028160 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚88132112992768 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚100825508824832 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚16592490 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3892367 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚16592490 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚102555170834432 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚13528562 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚30121050 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚30121050 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚12296461 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320eì2šè&  âM TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174647296 trainer/global_step‚749 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 890821159424 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 818056422755 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _runtime‚ 833.52414202 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚13528560 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚3891851 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚30144348 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚8404610 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚12296980 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 818837904839 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 `ODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 890970903040 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 821597722112 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚16615786 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 [HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚89023083895808 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚103375968028160 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚88132112992768 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚100825508824832 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚16592490 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚3892367 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚16592490 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚102555170834432 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚13528562 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚30121050 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚30121050 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚12296461 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚101643548208227 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚13528562 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚103376768556544 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚102555170834432;{Þ7Ô0¡ + _wandbruntime‚833  _runtime‚833i7v÷R¢ Ì /loss/FRt2/detection_loss‚2.3277406878009135 0loss/FRt4/assignment_loss‚4.3923881657152295 /loss/FBt3/detection_loss‚2.5462716911968433 # _timestamp‚1.78847918141582e+09 0loss/FBt2/assignment_loss‚0.2423777716855208 0loss/SRqqt4/detection_loss‚2.862972572174939 trainer/global_step‚749 _step‚60 .loss/FBt2/detection_loss‚3.548087457815806 1loss/SRqqt3/assignment_loss‚1.957139224370024 1loss/SRqqt4/assignment_loss‚2.273288420655511 /loss/FRt1/detection_loss‚1.8867947215786074 /loss/FRt4/detection_loss‚2.5986152783215766 /loss/FBt1/detection_loss‚0.6730243518312802 _runtime‚ 833.525853518 2loss/SRqqt1/assignment_loss‚1.3221917623560207 /loss/FRt2/assignment_loss‚4.413169469152178 0loss/FBt1/assignment_loss‚0.2139813602132642 1loss/SRqqt1/detection_loss‚1.0612183194473492 0loss/SRqqt2/detection_loss‚1.801840247158651 1loss/FBt3/assignment_loss‚0.20382939881988263 1loss/FBt4/assignment_loss‚0.20749810114300446 %loss/total_loss‚51.50685619997479 epoch‚1 0loss/FRt1/assignment_loss‚2.3341431841991915 0loss/SRqqt2/assignment_loss‚1.71749129952104 1loss/SRqqt3/detection_loss‚2.6110496294142593 0loss/FRt3/assignment_loss‚4.7682033797441905 .loss/FRt3/detection_loss‚2.921571446677386 .loss/FBt4/detection_loss‚2.621968258982119ãìïV£ Ð 0loss/FRt3/assignment_loss‚4.7682033797441905 .loss/FRt3/detection_loss‚2.921571446677386 .loss/FBt4/detection_loss‚2.621968258982119 /loss/FRt2/detection_loss‚2.3277406878009135 0loss/FRt4/assignment_loss‚4.3923881657152295 /loss/FBt3/detection_loss‚2.5462716911968433 # _timestamp‚1.78847918141582e+09 0loss/FBt2/assignment_loss‚0.2423777716855208 0loss/SRqqt4/detection_loss‚2.862972572174939 trainer/global_step‚749 _step‚60 .loss/FBt2/detection_loss‚3.548087457815806 1loss/SRqqt3/assignment_loss‚1.957139224370024 1loss/SRqqt4/assignment_loss‚2.273288420655511 /loss/FRt1/detection_loss‚1.8867947215786074 /loss/FRt4/detection_loss‚2.5986152783215766 /loss/FBt1/detection_loss‚0.6730243518312802 _runtime‚ 833.525853518 2loss/SRqqt1/assignment_loss‚1.3221917623560207 /loss/FRt2/assignment_loss‚4.413169469152178 0loss/FBt1/assignment_loss‚0.2139813602132642 1loss/SRqqt1/detection_loss‚1.0612183194473492 0loss/SRqqt2/detection_loss‚1.801840247158651 1loss/FBt3/assignment_loss‚0.20382939881988263 1loss/FBt4/assignment_loss‚0.20749810114300446 %loss/total_loss‚51.50685619997479 epoch‚1 0loss/FRt1/assignment_loss‚2.3341431841991915 0loss/SRqqt2/assignment_loss‚1.71749129952104 1loss/SRqqt3/detection_loss‚2.6110496294142593<‡mg”¤ ‚(:‰ ÓèÔèçÄ© gpu.0.gpu‚47.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚217.675' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.41875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0€O©4^¥ ‚(:Ó ÓèÔ…ˆ©« disk.rbd2.in‚0 disk.rbd2.out‚ 0.279296875" disk.nvme0n1.out‚ 5393.30078125) proc.memory.availableMB‚ 6227.42578125* proc.memory.percent‚19.314241409301758 network.sent‚ 1.253707e+06 disk.sdb2.in‚ 8.8046875 disk.sdb1.in‚0 disk.sdb.out‚96.81103515625 disk.sda2.out‚96.81103515625 disk.sda.out‚96.81103515625 disk.sdb.in‚ 8.8046875$ memory_percent‚61.99080944061279 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 53.67578125 disk.md0p1.out‚ 93.40234375 disk.sda.in‚ 53.67578125 disk.nvme0n1.in‚0 cpu‚25.525011938729342 disk.sdb2.out‚96.81103515625 disk.md0.in‚ 62.48046875 disk.md0p1.in‚ 62.48046875 disk.dm-0.out‚ 9855.91796875 disk.sda1.in‚0" proc.memory.rssMB‚ 3164.4453125 network.recv‚358413' disk./.usagePercent‚83.179409883967$ disk./.usageGB‚2974.898597717285 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.md0.out‚ 93.40234375 disk.rbd0.out‚ 0.279296875 disk.sda1.out‚0 proc.cpu.threads‚17! disk.nvme1n1.out‚ 4462.6171875 disk.dm-0.in‚ 32.45703125ã7üÛ“¦ ‚(:ˆ âèÔöƾ« gpu.0.gpu‚27.0 gpu.0.memory‚7, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚219.242' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.8105 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0˜Î@âX§ ‚(:Í âèÔüÐ÷« network.sent‚ 1.328413e+06 disk.sdb2.in‚ 8.8046875 disk.md0p1.out‚ 95.16015625* proc.memory.percent‚19.314289093017578 disk.md0.out‚ 95.16015625 network.recv‚362811 disk.sda1.out‚0 disk.nvme0n1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.8046875 disk.sda2.in‚ 53.67578125 disk.md0.in‚ 62.48046875 disk.dm-0.in‚ 32.45703125 disk.dm-0.out‚ 10008.4765625 disk.rbd2.in‚0 disk.rbd2.out‚ 0.279296875 disk.sda.out‚ 98.6259765625 disk.rbd0.in‚0 disk.rbd0.out‚ 0.279296875( proc.memory.availableMB‚ 6227.0859375% disk./.usageGB‚2974.9315795898438 disk.sdb1.in‚0 disk.sdb2.out‚ 98.6259765625 proc.cpu.threads‚17! proc.memory.rssMB‚ 3164.453125) disk./.usagePercent‚83.18033207092772 disk.sda1.in‚0$ memory_percent‚61.99288368225098 cpu‚25.524834707234106 disk.nvme1n1.out‚ 4493.96875 disk.sdb.out‚ 98.6259765625 disk.md0p1.in‚ 62.48046875 disk.sdb1.out‚0 disk.sda.in‚ 53.67578125! disk.nvme0n1.out‚ 5514.5078125 disk.sda2.out‚ 98.6259765625„Ý&Ÿ¨ ‚(:” ñèÔ®úŠ« gpu.0.gpu‚58.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚211.163' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚52.790749999999996 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0BÊ­Z© ‚(:Ï ñèÔ‡Ôë disk.sdb1.in‚0 disk.sda.out‚ 100.349609375 disk.sda1.out‚0) disk./.usagePercent‚83.18638334955712 disk.sdb1.out‚0$ memory_percent‚61.99135780334473 cpu‚25.524723505766392 proc.cpu.threads‚17 disk.sda2.in‚ 53.67578125 disk.dm-0.out‚10066.81640625 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚ 100.349609375 disk.sdb2.out‚ 100.349609375" disk.nvme1n1.out‚ 4552.08984375% disk./.usageGB‚2975.1480026245117 disk.sdb2.in‚ 8.8046875 disk.md0p1.out‚ 96.8203125 disk.dm-0.in‚ 32.45703125 disk.sda1.in‚0 disk.sdb.in‚ 8.8046875( proc.memory.availableMB‚ 6227.3359375 network.sent‚ 1.335068e+06 disk.rbd0.out‚ 0.279296875! disk.nvme0n1.out‚ 5514.7265625! proc.memory.rssMB‚ 3164.453125* proc.memory.percent‚19.314289093017578 network.recv‚367783 disk.sda2.out‚ 100.349609375 disk.rbd0.in‚0 disk.md0p1.in‚ 62.48046875 disk.rbd2.out‚ 0.279296875 disk.sda.in‚ 53.67578125 disk.nvme0n1.in‚0 disk.md0.in‚ 62.48046875 disk.md0.out‚ 96.8203125 disk.rbd2.in‚0fõã0ª + _wandbruntime‚882  _runtime‚882~æi„Ä« ¾ & lr-AdamW/pg1‚0.0011924336845440114 & lr-AdamW/pg2‚0.0011924336845440114 trainer/global_step‚799 % _timestamp‚1.7884792301203566e+09 _runtime‚ 882.230781401 _step‚61žšfZȬ  trainer/global_step‚799 % _timestamp‚1.7884792301203566e+09 _runtime‚ 882.230781401 _step‚61 & lr-AdamW/pg1‚0.0011924336845440114 & lr-AdamW/pg2‚0.0011924336845440114=yPë&0­ + _wandbruntime‚882  _runtime‚882~uàŽ›® ÓO LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚109059968076800 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚32065534 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚519 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚107227351636432 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚13068643 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚8931853 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 947492569600 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚14383708 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚108098308273405 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚4136790 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚93725159333888 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚109933861255168 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚109933060740096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚94672626999808 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 Iitor.on_train_batch_start/active.small_pool.freed‚17658554 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚4136274 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚93725134430208 _step‚62 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚109933060740096 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚17658554 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚8931850 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚94672812146176 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 870939597613 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚109059985116160 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚109059968076800 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 873876139008 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 873092663296 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚17681824 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 870158115737 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚14383710 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 947652812288 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 _runtime‚ 882.23276829 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 trainer/global_step‚799 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚14383708 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚17681824 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚13068124 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 873092663296 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚108097509752169ÁÌÔ:Ý'¯ ×O YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚109933861255168 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚109933060740096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 YFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚94672626999808 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚109933060740096 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚17658554 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚8931850 ]JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚94672812146176 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 870939597613 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚109059985116160 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚109059968076800 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 873876139008 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 873092663296 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚17681824 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 870158115737 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚14383710 bQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 947652812288 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 _runtime‚ 882.23276829 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 trainer/global_step‚799 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚14383708 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚17681824 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚13068124 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 873092663296 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚108097509752169 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚109059968076800 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚32065534 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚519 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚107227351636432 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚13068643 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚8931853 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ^MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 947492569600 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚14383708 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚108098308273405 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚4136790 dQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚93725159333888 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475>¸>íM0° + _wandbruntime‚883  _runtime‚883ª|å&± ßM K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚32104700 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 871220861063 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚14401162 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚108230021219979 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 872002343147 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚8942613 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚17680242 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚109192736428032 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚14401160 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 948628817920 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚93839303136768 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚4141349 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚94787907051008 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚108229222698535 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚109192719388672 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚17703538 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 % _timestamp‚1.7884792311549535e+09 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚109192719388672 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚110067678919168 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚13083959 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚107358001837472 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚14401160 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 166520832 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 874942491136 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 191424512 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 WDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚94787907051008 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚108229222698535 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚109192719388672 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚17703538 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 % _timestamp‚1.7884792311549535e+09 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚109192719388672 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚110067678919168 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚13083959 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚107358001837472 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚14401160 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 166520832 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 874942491136 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 191424512 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚32104700 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 871220861063 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚14401162 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚108230021219979 [JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 872002343147 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚8942613 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚17680242 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚109192736428032 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚14401160 \KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 948628817920 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚93839303136768 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚4141349 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚115697533670400 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚113759861688432 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚34002614 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚116624771617792 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 % _timestamp‚1.7884792794762928e+09 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚13856949 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚4387096 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚113759878727792 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚115697533670400 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 trainer/global_step‚849 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 923322554045 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚18769576 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚536 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 927220908032 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚34025886 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚4386563 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚100438007555072 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚116623971102720 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 926437432320 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚114683982763713 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚116623971102720 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1005658077184 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 924104035921 _step‚66 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156048384 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚114683184242477 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 926437432320 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚15256310 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚18746306 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚116624771617792 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚533 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚18746306 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚9469850 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180952064 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚100437826603008 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚15256308 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1005502028800 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚99432324574208 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 _runtime‚ 931.586723669¯r“Ñ'à ÝO trainer/global_step‚849 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 923322554045 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚18769576 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚536 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 927220908032 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚34025886 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚4386563 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚100438007555072 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚116623971102720 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 926437432320 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚114683982763713 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚116623971102720 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1005658077184 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 924104035921 _step‚66 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156048384 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚114683184242477 VEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 926437432320 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚15256310 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚18746306 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚116624771617792 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚533 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚18746306 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚9469850 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180952064 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚100437826603008 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚15256308 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1005502028800 `MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚99432324574208 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 _runtime‚ 931.586723669 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚115697550709760 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚115697533670400 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚113759861688432 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚34002614 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚116624771617792 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 % _timestamp‚1.7884792794762928e+09 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚13856949 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚4387096 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚113759878727792 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚115697533670400 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peakåÚ÷ñ‚ 25794969600BÒQû;0Ä + _wandbruntime‚932  _runtime‚932yÎsé&Å ãM LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 927503771136 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚9480613 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156035072 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1006656771584 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚113890528928832 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚15273762 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚116758589281792 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚34065052 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚34041754 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 928287260160 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚115830302021632 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚115830284982272 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚34041754 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚4392136 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚116758589281792 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 927503771136 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚99546493280768 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚15273760 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚100553125148672 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 trainer/global_step‚849 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚114815695710287 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 % _timestamp‚1.7884792803201876e+09 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1006812806656 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚34065052 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚116757788753408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚100553306087424 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 _step‚67 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚114814897188843 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚9480610 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚4391627 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚18791290 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚15273760 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚13872237 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚113890511889472 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309ûšÝØí&Æ çM B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚15273762 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚116758589281792 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚34065052 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚34041754 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 [JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 928287260160 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚115830302021632 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚115830284982272 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚34041754 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚4392136 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚116758589281792 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 WFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 927503771136 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 bODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚99546493280768 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚15273760 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚100553125148672 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 trainer/global_step‚849 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚114815695710287 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 % _timestamp‚1.7884792803201876e+09 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1006812806656 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚34065052 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚116757788753408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚100553306087424 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 _step‚67 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚114814897188843 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚9480610 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚4391627 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚18791290 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚15273760 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚13872237 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚113890511889472 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 927503771136 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚9480613 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156035072 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1006656771584 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚113890528928832C}Lp€0Ç + _wandbruntime‚932  _runtime‚932ã¥UÈ Ï 0loss/FRt1/assignment_loss‚1.6329072132168045 _step‚68 /loss/FRt3/detection_loss‚3.0936958629775932 &loss/total_loss‚48.292306041876444 _runtime‚ 932.432592808 /loss/FRt4/assignment_loss‚4.117632746696472 2loss/SRqqt3/assignment_loss‚2.1249334209731647 0loss/FBt1/assignment_loss‚0.1628893405634748 0loss/FBt4/assignment_loss‚0.3019619074392332 /loss/FBt1/detection_loss‚0.6344087765844805 .loss/FBt3/detection_loss‚2.845499767197503 /loss/FRt2/assignment_loss‚3.689521176557915 /loss/FRt3/assignment_loss‚4.158957244069488 2loss/SRqqt1/assignment_loss‚1.0769241441889936 /loss/FRt1/detection_loss‚1.9538480702293926 /loss/FBt2/detection_loss‚2.5057992140452066 0loss/SRqqt2/detection_loss‚1.829134810330539 .loss/FBt4/detection_loss‚2.437778979539871 % _timestamp‚1.7884792803225203e+09 1loss/SRqqt2/assignment_loss‚1.841920080402031 2loss/SRqqt4/assignment_loss‚1.9571610252585327 .loss/FRt2/detection_loss‚2.578716276615274 /loss/FRt4/detection_loss‚2.5952378342181075 1loss/SRqqt3/detection_loss‚2.4069941090685982 epoch‚1 0loss/FBt2/assignment_loss‚0.2616240841339782 trainer/global_step‚849 0loss/FBt3/assignment_loss‚0.3199370914889086 1loss/SRqqt1/detection_loss‚1.0868288919389728 1loss/SRqqt4/detection_loss‚2.6779939741419074Œ|É'YÉ Ó 0loss/FBt3/assignment_loss‚0.3199370914889086 1loss/SRqqt1/detection_loss‚1.0868288919389728 1loss/SRqqt4/detection_loss‚2.6779939741419074 0loss/FRt1/assignment_loss‚1.6329072132168045 _step‚68 /loss/FRt3/detection_loss‚3.0936958629775932 &loss/total_loss‚48.292306041876444 _runtime‚ 932.432592808 /loss/FRt4/assignment_loss‚4.117632746696472 2loss/SRqqt3/assignment_loss‚2.1249334209731647 0loss/FBt1/assignment_loss‚0.1628893405634748 0loss/FBt4/assignment_loss‚0.3019619074392332 /loss/FBt1/detection_loss‚0.6344087765844805 .loss/FBt3/detection_loss‚2.845499767197503 /loss/FRt2/assignment_loss‚3.689521176557915 /loss/FRt3/assignment_loss‚4.158957244069488 2loss/SRqqt1/assignment_loss‚1.0769241441889936 /loss/FRt1/detection_loss‚1.9538480702293926 /loss/FBt2/detection_loss‚2.5057992140452066 0loss/SRqqt2/detection_loss‚1.829134810330539 .loss/FBt4/detection_loss‚2.437778979539871 % _timestamp‚1.7884792803225203e+09 1loss/SRqqt2/assignment_loss‚1.841920080402031 2loss/SRqqt4/assignment_loss‚1.9571610252585327 .loss/FRt2/detection_loss‚2.578716276615274 /loss/FRt4/detection_loss‚2.5952378342181075 1loss/SRqqt3/detection_loss‚2.4069941090685982 epoch‚1 0loss/FBt2/assignment_loss‚0.2616240841339782 trainer/global_step‚849DF ߟÊ ‚(:” ¼ŽèÔ‚…« gpu.0.gpu‚64.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚118.474' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚29.618500000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0UwäžiË ‚(:Þ ¼ŽèÔÁ®§« disk.rbd0.out‚ 0.279296875 disk.sdb1.in‚0 disk.md0.in‚ 62.58984375 disk.dm-0.in‚ 61.69921875 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda.in‚ 53.73046875 disk.sda1.out‚0! disk.sda2.out‚108.99560546875 proc.cpu.threads‚17 disk.dm-0.out‚10717.29296875 disk.rbd2.out‚ 0.279296875% disk./.usageGB‚2975.4551544189453 disk.md0p1.in‚ 62.58984375 disk.sda.out‚108.99560546875" disk.nvme1n1.out‚ 5014.85546875 disk.sda2.in‚ 53.73046875 cpu‚25.52412014376198 disk.md0p1.out‚ 105.16015625 disk.sdb.out‚108.99560546875! disk.sdb2.out‚108.99560546875 network.sent‚ 1.440932e+06) disk./.usagePercent‚83.19497144228248 disk.md0.out‚ 105.16015625 disk.rbd0.in‚0 disk.sda1.in‚0 disk.nvme0n1.in‚ 29.2421875 disk.sdb2.in‚8.859375 disk.nvme0n1.out‚ 5702.4375 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚8.859375' proc.memory.availableMB‚ 5701.734375) proc.memory.percent‚19.31436061859131 network.recv‚388085$ memory_percent‚65.19937515258789# proc.memory.rssMB‚ 3164.46484375­àÊ*•Ì ‚(:Š ËŽèÔ˜óë© gpu.0.gpu‚84.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚132.399' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚33.09975 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0†Ç¦mÍ ‚(:â ËŽèÔïüÞª disk.sdb1.in‚0" disk.nvme1n1.out‚ 5130.95703125 disk.sdb.in‚8.859375) proc.memory.availableMB‚ 5283.91015625 cpu‚25.52378975561416 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚110.96240234375 disk.rbd0.in‚0 disk.dm-0.in‚ 61.69921875 disk.sda.out‚110.96240234375 disk.sdb.out‚110.96240234375 disk.sdb1.out‚0 disk.sda1.out‚0 disk.nvme0n1.out‚ 5709.703125 disk.sdb2.in‚8.859375 disk.sda2.in‚ 53.73046875 network.sent‚ 1.527567e+06! disk.sda2.out‚110.96240234375 disk.md0.out‚ 107.05859375 disk.md0p1.in‚ 62.58984375 proc.cpu.threads‚17 network.recv‚393706% disk./.usageGB‚2975.4610328674316 disk.sda1.in‚0 disk.rbd2.out‚ 0.279296875$ memory_percent‚67.74957180023193) proc.memory.percent‚19.31436061859131) disk./.usagePercent‚83.19513580616248 disk.sda.in‚ 53.73046875 disk.nvme0n1.in‚ 29.2421875 disk.md0.in‚ 62.58984375 disk.dm-0.out‚10840.66015625# proc.memory.rssMB‚ 3164.46484375 disk.md0p1.out‚ 107.05859375 disk.rbd0.out‚ 0.279296875 disk.rbd2.in‚0Ö@•Î ‚(:Š ÚŽèÔ¶ÿÙ© gpu.0.gpu‚54.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚134.575' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚33.64375 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0;×–Ñ]Ï ‚(:Ò ÚŽèÔ‘Ÿ¡« network.recv‚397208 disk.nvme0n1.out‚5709.75 disk.sdb1.in‚0 disk.dm-0.out‚ 10953.484375 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.out‚112.73388671875 disk.md0p1.in‚ 62.58984375 disk.rbd0.out‚ 0.279296875$ memory_percent‚68.90277862548828 cpu‚25.52390174890182 disk.sda2.in‚ 53.73046875! disk.sda2.out‚112.73388671875 disk.md0p1.out‚ 108.765625 network.sent‚ 1.534904e+06$ disk./.usageGB‚2974.933448791504 disk.nvme1n1.out‚ 5243.734375 disk.md0.in‚ 62.58984375 disk.sdb1.out‚0 disk.rbd2.in‚0 disk.sda.in‚ 53.73046875 disk.sdb2.in‚8.859375 disk.md0.out‚ 108.765625 disk.rbd0.in‚0 disk.dm-0.in‚ 61.69921875) proc.memory.percent‚19.31436061859131 proc.cpu.threads‚17) disk./.usagePercent‚83.18038433458845 disk.nvme0n1.in‚ 29.2421875 disk.sdb.in‚8.859375& proc.memory.availableMB‚ 5094.96875 disk.sda.out‚112.73388671875 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚112.73388671875 disk.rbd2.out‚ 0.279296875# proc.memory.rssMB‚ 3164.46484375²F’0Ð + _wandbruntime‚981  _runtime‚981Ñ#‡ÄÑ ¾ & lr-AdamW/pg1‚0.0011875563980302533 & lr-AdamW/pg2‚0.0011875563980302533 trainer/global_step‚899 % _timestamp‚1.7884793289450727e+09 _runtime‚ 981.055356082 _step‚69„{:òÈÒ Â & lr-AdamW/pg1‚0.0011875563980302533 & lr-AdamW/pg2‚0.0011875563980302533 trainer/global_step‚899 % _timestamp‚1.7884793289450727e+09 _runtime‚ 981.055356082 _step‚69E[40Ó + _wandbruntime‚981  _runtime‚981H‘e ¤Ô ÜO BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚121268858732785 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚16128910 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytú9oÎ>es.large_pool.freed‚122335099264000 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 trainer/global_step‚899 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚19834058 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚122335116303360 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚14646726 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚120292371740432 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚16128908 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 980565677056 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚35986238 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚105139539621888 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚120292388779792 _runtime‚ 981.056507828 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 979782201344 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚16128910 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚19834058 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚105139514718208 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚122335116303360 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 980565677056 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚19857328 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚123314881465344 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 976486992353 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149756928 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚123314881465344 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174660608 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚14647260 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚4638876 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 977268474229 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚123315681980416 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808(ŽOlæ'Õ àO SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚4638876 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ]LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 977268474229 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚123315681980416 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚121268858732785 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚16128910 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚122335099264000 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 trainer/global_step‚899 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚19834058 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚122335116303360 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚14646726 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚120292371740432 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚16128908 ]LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 980565677056 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚35986238 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚105139539621888 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚120292388779792 _runtime‚ 981.056507828 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 YHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 979782201344 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚16128910 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚19834058 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚105139514718208 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚122335116303360 ZIDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 980565677056 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚19857328 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚123314881465344 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 YHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 976486992353 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149756928 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚123314881465344 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174660608 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚14647260 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2F¾¬ª0Ö + _wandbruntime‚982  _runtime‚982Ó][Qì&× æM RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚536 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚122467850575872 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 % _timestamp‚1.7884793300243664e+09 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚122467867615232 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚14663049 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚106318410910720 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚36025404 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚4644436 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162326528 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1064565159424 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚19879042 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚16146362 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚10018613 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 _runtime‚ 982.13531335 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚19879042 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚123448699116032 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚16146360 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 _step‚71 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚36002106 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚120423021941472 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 980848540160 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚533 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚122467867615232 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187230208 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 981632029184 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 977549737679 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚106318223680512 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚16146360 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚19855746 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚10018610 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚14662513 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚123449499644416 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚36025404 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚19855746 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475+4@×Ø êM F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚4644436 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162326528 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1064565159424 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚19879042 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚16146362 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚10018613 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 _runtime‚ 982.13531335 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚19879042 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚123448699116032 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚16146360 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 _step‚71 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚36002106 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚120423021941472 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 TCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 980848540160 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚533 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚122467867615232 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187230208 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 981632029184 WFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 977549737679 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚106318223680512 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚16146360 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚19855746 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚10018610 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚14662513 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚123449499644416 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚36025404 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚19855746 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚536 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚122467850575872 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 % _timestamp‚1.7884793300243664e+09 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚122467867615232 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚14663049 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚106318410910720 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚36025404 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354GnÍž!0Ù + _wandbruntime‚982  _runtime‚982rÉ)rYÚ Ó /loss/FRt4/assignment_loss‚4.231788594548295 2loss/SRqqt1/assignment_loss‚1.0491163440395233 _step‚72 /loss/FRt3/assignment_loss‚4.240531628591972 2loss/SRqqt4/assignment_loss‚1.6238275005058809 1loss/SRqqt1/detection_loss‚0.9070725895810959 %loss/total_loss‚47.57792848957274 0loss/FRt1/assignment_loss‚1.7940170655125065 /loss/FRt1/detection_loss‚1.5612715824523515 /loss/FRt3/detection_loss‚3.0383393680840207 /loss/FBt1/detection_loss‚0.6769164296819817 .loss/FBt4/detection_loss‚2.911885146911328 1loss/FBt2/assignment_loss‚0.25967377212575893 1loss/FBt4/assignment_loss‚0.16095208007699022 0loss/SRqqt3/detection_loss‚2.536154259764959 1loss/SRqqt4/detection_loss‚2.6654351126063953 /loss/FBt2/detection_loss‚3.1199793382124468 epoch‚1 trainer/global_step‚899 .loss/FRt2/detection_loss‚2.407330818559932 $ _timestamp‚1.788479330026277e+09 2loss/SRqqt2/assignment_loss‚1.7791290116997867 1loss/SRqqt3/assignment_loss‚2.160436113202383 1loss/FBt1/assignment_loss‚0.08123584945091557 1loss/FBt3/assignment_loss‚0.22960570068015065 /loss/FRt4/detection_loss‚2.4908196079294855 0loss/FRt2/assignment_loss‚3.8096932289244116 1loss/SRqqt2/detection_loss‚1.7315095024995315 /loss/FBt3/detection_loss‚2.1112078439306328 _runtime‚ 982.136286054´¾Á©]Û × 1loss/FBt2/assignment_loss‚0.25967377212575893 1loss/FBt4/assignment_loss‚0.16095208007699022 0loss/SRqqt3/detection_loss‚2.536154259764959 1loss/SRqqt4/detection_loss‚2.6654351126063953 /loss/FBt2/detection_loss‚3.1199793382124468 epoch‚1 trainer/global_step‚899 .loss/FRt2/detection_loss‚2.407330818559932 $ _timestamp‚1.788479330026277e+09 2loss/SRqqt2/assignment_loss‚1.7791290116997867 1loss/SRqqt3/assignment_loss‚2.160436113202383 1loss/FBt1/assignment_loss‚0.08123584945091557 1loss/FBt3/assignment_loss‚0.22960570068015065 /loss/FRt4/detection_loss‚2.4908196079294855 0loss/FRt2/assignment_loss‚3.8096932289244116 1loss/SRqqt2/detection_loss‚1.7315095024995315 /loss/FBt3/detection_loss‚2.1112078439306328 _runtime‚ 982.136286054 /loss/FRt4/assignment_loss‚4.231788594548295 2loss/SRqqt1/assignment_loss‚1.0491163440395233 _step‚72 /loss/FRt3/assignment_loss‚4.240531628591972 2loss/SRqqt4/assignment_loss‚1.6238275005058809 1loss/SRqqt1/detection_loss‚0.9070725895810959 %loss/total_loss‚47.57792848957274 0loss/FRt1/assignment_loss‚1.7940170655125065 /loss/FRt1/detection_loss‚1.5612715824523515 /loss/FRt3/detection_loss‚3.0383393680840207 /loss/FBt1/detection_loss‚0.6769164296819817 .loss/FBt4/detection_loss‚2.911885146911328Hq§žÜ ‚(:“ éŽèÔÇÍÔ« gpu.0.gpu‚57.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚225.525' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚56.38125000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0\6 žhÝ ‚(:Ý éŽèÔæꥬ! disk.sda2.out‚114.61962890625 disk.md0.out‚ 110.58984375 disk.rbd0.out‚ 0.279296875 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda.out‚114.61962890625 disk.nvme1n1.in‚ 32.45703125" disk.nvme1n1.out‚ 5244.61328125 disk.sdb2.in‚8.859375$ memory_percent‚68.90466213226318 disk.sda2.in‚ 53.73046875 disk.md0p1.in‚ 62.58984375 disk.rbd2.out‚ 0.279296875) proc.memory.availableMB‚ 5094.66015625 disk.nvme0n1.in‚ 29.2421875 disk.dm-0.in‚ 61.69921875 network.sent‚ 1.539424e+06 disk.sda.in‚ 53.73046875 disk.sda1.out‚0 disk.sdb.in‚8.859375 disk.sdb.out‚114.61962890625# proc.memory.rssMB‚ 3164.46484375 proc.cpu.threads‚17 network.recv‚401737 disk.sdb1.in‚0 disk.sda1.in‚0" disk.nvme0n1.out‚ 5782.13671875! disk.sdb2.out‚114.61962890625 disk.md0.in‚ 62.58984375 disk.rbd0.in‚0 disk.dm-0.out‚11026.75 cpu‚25.5232544479004) disk./.usagePercent‚83.18248544041073% disk./.usageGB‚2975.0085945129395 disk.md0p1.out‚ 110.58984375) proc.memory.percent‚19.31436061859131û òÒ“Þ ‚(:ˆ øŽèÔ¡®« gpu.0.gpu‚52.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚210.886' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.7215 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ò?šdß ‚(:Ù øŽèÔîÜò¬ disk.nvme0n1.in‚ 29.2421875 network.sent‚ 1.624741e+06) disk./.usagePercent‚83.18807989198103 disk.sda.out‚116.6806640625) proc.memory.availableMB‚ 5095.08984375 disk.sda.in‚ 53.73046875 disk.nvme1n1.out‚5244.75 disk.sda2.in‚ 53.73046875 proc.cpu.threads‚17% disk./.usageGB‚2975.2086791992188 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb2.in‚8.859375 disk.md0.out‚ 112.5703125 disk.md0p1.in‚ 62.58984375 disk.rbd0.in‚0 disk.rbd2.out‚ 0.279296875 disk.sdb1.in‚0 disk.rbd0.out‚ 0.279296875 disk.dm-0.in‚ 61.69921875 cpu‚25.522409064905318" disk.nvme0n1.out‚ 5983.33984375 disk.dm-0.out‚11228.08984375$ memory_percent‚68.90203952789307# proc.memory.rssMB‚ 3164.46484375 disk.md0.in‚ 62.58984375 disk.md0p1.out‚ 112.5703125 disk.rbd2.in‚0 network.recv‚406305 disk.sdb1.out‚0 disk.sdb.in‚8.859375 disk.sdb.out‚116.6806640625 disk.sdb2.out‚116.6806640625) proc.memory.percent‚19.31436061859131 disk.nvme1n1.in‚ 32.45703125 disk.sda2.out‚116.6806640625:£$Ÿà ‚(:” ‡èÔÀÁ£« gpu.0.gpu‚38.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¶n˜já ‚(:ß ‡èԹʬ disk.sda1.out‚0 disk.nvme0n1.in‚ 29.2421875 disk.md0p1.in‚ 62.58984375) proc.memory.availableMB‚ 5094.72265625 disk.sda1.in‚0! disk.sda2.out‚118.10009765625 disk.md0.in‚ 62.58984375 disk.md0.out‚ 113.93359375) proc.memory.percent‚19.31436061859131% disk./.usageGB‚2975.4922256469727 disk.dm-0.in‚ 61.69921875 disk.sdb.out‚118.10009765625 disk.sdb2.in‚8.859375! disk.sdb2.out‚118.10009765625 disk.sda2.in‚ 53.73046875 disk.sdb.in‚8.859375 disk.rbd0.out‚ 0.279296875 disk.sdb1.in‚0! disk.nvme1n1.out‚ 5245.2421875# proc.memory.rssMB‚ 3164.46484375 network.sent‚ 1.631355e+06 disk.sdb1.out‚0 disk.md0p1.out‚ 113.93359375 disk.rbd0.in‚0 cpu‚25.52236764844013 network.recv‚411014 disk.rbd2.out‚ 0.279296875 disk.sda.out‚118.10009765625! disk.nvme0n1.out‚ 6158.9140625 disk.nvme1n1.in‚ 32.45703125$ memory_percent‚68.90428066253662 disk.dm-0.out‚ 11404.15625 proc.cpu.threads‚17) disk./.usagePercent‚83.19600796933365 disk.rbd2.in‚0 disk.sda.in‚ 53.73046875·4£2â - _wandbruntime‚1034  _runtime‚1034†)6›Åã ¿ & lr-AdamW/pg1‚0.0011843784176845272 & lr-AdamW/pg2‚0.0011843784176845272 trainer/global_step‚949 % _timestamp‚1.7884793820040753e+09 _runtime‚1034.114505227 _step‚73:žyÉä à & lr-AdamW/pg1‚0.0011843784176845272 & lr-AdamW/pg2‚0.0011843784176845272 trainer/global_step‚949 % _timestamp‚1.7884793820040753e+09 _runtime‚1034.114505227 _step‚73ILõÉ2å - _wandbruntime‚1034  _runtime‚1034±´¢+ê'æ äO XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 % _timestamp‚1.7884793820054448e+09 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚15437343 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚17001508 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚10545853 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚17001508 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1029651430661 trainer/global_step‚949 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚130005791827968 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚15436822 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚4890972 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚128972681896960 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚126824898831792 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚128972681896960 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1030432912537 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚17001510 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚37946590 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚1034.115838083 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚130005791827968 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚111968450253312 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1121720487424 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚37923318 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1033910446080 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176757760 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚128972664857600 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚20945080 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚4891490 _step‚74 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚518 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚127854533223093 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚17001510 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚126824881792432 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚130006592343040 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚10545850 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚128972664857600 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚20945080 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151854080 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚110846729765888 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚20921810 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚1034.115838083 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚130005791827968 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚111968450253312 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1000 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1121720487424 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚37923318 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1743 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1033910446080 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176757760 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚128972664857600 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚20945080 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚4891490 _step‚74 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚518 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚127854533223093 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚17001510 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚126824881792432 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚130006592343040 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚10545850 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚128972664857600 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚20945080 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151854080 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚110846729765888 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚20921810 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚10545853 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚17001508 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1029651430661 trainer/global_step‚949 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚130005791827968 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚15436822 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚4890972 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚128972681896960 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚126824898831792 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚128972681896960 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1030432912537 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784JÎ…q2è - _wandbruntime‚1034  _runtime‚1034’çð Gé íM YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1034976798208 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚20966794 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚10556610 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚523 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚17018962 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1030714175987 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 _step‚75 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚37962458 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 257949696<Étž¬!00 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚10556613 trainer/global_step‚949 % _timestamp‚1.7884793828625813e+09 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚15453164 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚129105416169472 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚4896551 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚110960873568768 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1122884054016 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚17018960 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚112083580878336 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚129105433208832 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1034193309184 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚526 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚15452638 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚127986246169459 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151840768 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚37962458 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚129105433208832 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚17018962 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚129105416169472 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚20943498 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176744448 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1034976798208 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1031495658071 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚37985756 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚130140410007040 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚126955549032832 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚130139609478656 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚37985756 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _runtime‚ 1034.97347617 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚129105433208832 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1000 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1034193309184 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚526 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚15452638 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚127986246169459 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151840768 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚37962458 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚129105433208832 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚17018962 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚129105416169472 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚20943498 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176744448 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1034976798208 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1031495658071 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚37985756 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1743 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚130140410007040 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚126955549032832 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚130139609478656 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚37985756 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _runtime‚ 1034.97347617 EDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _runtime‚1086.571357335 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚135610247490560 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153951232 _step‚78 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚136697502705664 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚135610247490560 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚17874110 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚136696702190592 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178854912 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1179929683456 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1087255215104Æøî'û èO QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚116553895006208 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚134440207713401 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1083597350845 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚17874108 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1179775732224 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚11083850 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚136697502705664 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚5143397 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚513 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚135610230451200 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1082815868969 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚133357391844432 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚22032832 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1087255215104 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚510 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 % _timestamp‚1.7884794344609797e+09 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚136697502705664 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚135610247490560 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚17874110 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚136696702190592 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178854912 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1179929683456 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1087255215104 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚39906942 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚17874110 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚116553919909888 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚17874108 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚136696702190592 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚16227247 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚22009562 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _runtime‚1086.571357335 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚135610247490560 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153951232 _step‚78 IDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚39946108 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚17891562 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚39946108 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚17891562 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚136831320369664 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚135742998802432 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚135742998802432 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚135742981763072 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚22054546 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚16243559 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚22054546 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚135742981763072 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1083878614295 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1180935256064 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1181089193984 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚134572719181211 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚136831320369664 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153937920 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚11094613 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚136830519841280 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1088321567232 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1087538078208 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚134571920659767 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚11094610 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚133488042045472 _runtime‚1087.433018884 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚5148440 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚117848974065152 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1084660096379 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚16243050 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚39922810 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178841600 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚22031250 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚135742998802432 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚135742981763072 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚22054546 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚16243559 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚22054546 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚135742981763072 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1083878614295 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1180935256064 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1181089193984 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚134572719181211 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚136831320369664 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153937920 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚11094613 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚136830519841280 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1088321567232 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1087538078208 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚134571920659767 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚11094610 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚133488042045472 _runtime‚1087.433018884 E?DeviceSt1ѹ atsMonitor.on_train_batch_end/active.large_pool.current‚2 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚5148440 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚117848974065152 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1084660096379 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚16243050 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚39922810 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178841600 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚22031250 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚39946108 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚17891562 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚39946108 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚17891562 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚136831320369664 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚135742998802432 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 EDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚11621853 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1237810546688 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚143388413068288 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178854912 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚143387612553216 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚527 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚11621850 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 trainer/global_step‚1049 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚139889918935792 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚142247813084160 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1140599984128 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1140599984128 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚122261085150208 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚141026680724945 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚5396018 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚23097314 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚11621853 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1237810546688 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚143388413068288 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178854912 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚143387612553216 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚527 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚11621850 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 trainer/global_step‚1049 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚139889918935792 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚142247813084160 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1140599984128 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [Iíß;DeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1140599984128 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚122261085150208 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚141026680724945R¥´bß2 - _wandbruntime‚1143  _runtime‚1143GeÃõ&‘ ïM I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚142380547356672 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚140020569136832 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚143522230732288 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1140882847232 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚123614194554880 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚18764160 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚11632610 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 % _timestamp‚1.7884794912089517e+09 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1239121636864 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚11632613 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚41906460 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚41883162 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚23119002 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚142380564396032 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚143521430203904 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚122375253856768 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚5401046 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚123614375493632 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚18764162 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180938752 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156035072 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚41906460 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚5401562 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚141157595150075 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚18764162 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1137043052603 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 _step‚83 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚18764160 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚17033656 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1137824534687 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚23119002 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1238965601792 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180938752 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156035072 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚41906460 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚5401562 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚141157595150075 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚18764162 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1137043052603 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 _step‚83 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚18764160 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚17033656 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1137824534687 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚23119002 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1238965601792 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚143522230732288 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1140882847232 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚123614194554880 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚18764160 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚11632610 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 % _timestamp‚1.7884794912089517e+09 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1239121636864 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚11632613 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚41906460 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚41883162 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚23119002 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚142380564396032 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚143521430203904 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚122375253856768SÑÃû•2“ - _wandbruntime‚1143  _runtime‚1143}À U” Ï /loss/FRt2/assignment_loss‚2.303716336886088 0loss/FBt4/assignment_loss‚0.0685851378219762 .loss/FRt3/detection_loss‚2.733161121606827 2loss/SRqqt4/assignment_loss‚1.8794684800945345 1loss/FBt1/assignment_loss‚0.12085018761972365 .loss/FRt1/detection_loss‚1.877456709115329 /loss/FBt1/detection_loss‚0.7621790879849819 .loss/FBt3/detection_loss‚3.607279961759394 1loss/SRqqt2/assignment_loss‚1.629262809252997 1loss/FBt2/assignment_loss‚0.17571825238077768 /loss/FRt4/detection_loss‚2.1327976174558505 trainer/global_step‚1049 .loss/FRt2/detection_loss‚2.527064947684606 1loss/SRqqt1/detection_loss‚0.9701409292221069 0loss/SRqqt3/detection_loss‚2.239361234009266 -loss/FBt4/detection_loss‚2.54762443374185 epoch‚1 /loss/FRt1/assignment_loss‚1.649557847149518 2loss/SRqqt1/assignment_loss‚1.0273523012300332 1loss/SRqqt4/detection_loss‚2.4611371340321715 % _timestamp‚1.7884794912107766e+09 0loss/FRt3/assignment_loss‚3.8495441777365547 1loss/FBt3/assignment_loss‚0.23840341255576772 _runtime‚1143.320854178 0loss/FRt4/assignment_loss‚3.7649492476925706 1loss/SRqqt3/assignment_loss‚2.150030495090918 $loss/total_loss‚45.3878200969157 _step‚84 1loss/SRqqt2/detection_loss‚1.6680441417797345 /loss/FBt2/detection_loss‚3.0041340930121287Öð¯Y• Ó 0loss/FRt4/assignment_loss‚3.7649492476925706 1loss/SRqqt3/assignment_loss‚2.150030495090918 $loss/total_loss‚45.3878200969157 _step‚84 1loss/SRqqt2/detection_loss‚1.6680441417797345 /loss/FBt2/detection_loss‚3.0041340930121287 /loss/FRt2/assignment_loss‚2.303716336886088 0loss/FBt4/assignment_loss‚0.0685851378219762 .loss/FRt3/detection_loss‚2.733161121606827 2loss/SRqqt4/assignment_loss‚1.8794684800945345 1loss/FBt1/assignment_loss‚0.12085018761972365 .loss/FRt1/detection_loss‚1.877456709115329 /loss/FBt1/detection_loss‚0.7621790879849819 .loss/FBt3/detection_loss‚3.607279961759394 1loss/SRqqt2/assignment_loss‚1.629262809252997 1loss/FBt2/assignment_loss‚0.17571825238077768 /loss/FRt4/detection_loss‚2.1327976174558505 trainer/global_step‚1049 .loss/FRt2/detection_loss‚2.527064947684606 1loss/SRqqt1/detection_loss‚0.9701409292221069 0loss/SRqqt3/detection_loss‚2.239361234009266 -loss/FBt4/detection_loss‚2.54762443374185 epoch‚1 /loss/FRt1/assignment_loss‚1.649557847149518 2loss/SRqqt1/assignment_loss‚1.0273523012300332 1loss/SRqqt4/detection_loss‚2.4611371340321715 % _timestamp‚1.7884794912107766e+09 0loss/FRt3/assignment_loss‚3.8495441777365547 1loss/FBt3/assignment_loss‚0.23840341255576772 _runtime‚1143.320854178TÓÐvŸ– ‚(:” ŽèÔ鬫¬ gpu.0.gpu‚61.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚204.035' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚51.008750000000006 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÕÌ_— ‚(:Ô ŽèÔáË–­ network.sent‚ 1.843204e+06 disk.sdb.out‚133.4580078125 disk.md0p1.in‚ 62.58984375 cpu‚25.51579745127675 network.recv‚448710& disk./.usagePercent‚83.20905212577 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sdb2.out‚133.4580078125# proc.memory.rssMB‚ 3164.46484375) proc.memory.percent‚19.31436061859131 disk.nvme0n1.in‚ 220.71875 disk.nvme0n1.out‚ 7812.40625" disk.nvme1n1.out‚ 5323.73046875 disk.md0.in‚ 62.58984375 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sdb.in‚8.859375 disk.rbd0.out‚ 0.279296875 disk.dm-0.in‚ 253.17578125 disk.rbd2.in‚0 disk.sda.out‚133.4580078125 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 53.73046875 disk.sda2.out‚133.4580078125 disk.md0.out‚ 128.69140625# proc.memory.availableMB‚5095.25% disk./.usageGB‚2975.9587478637695 disk.sdb2.in‚8.859375 disk.md0p1.out‚ 128.69140625 disk.dm-0.out‚13136.13671875 disk.rbd2.out‚ 0.279296875 proc.cpu.threads‚17 disk.sda.in‚ 53.73046875 disk.sda1.out‚0$ memory_percent‚68.90106201171875üQ·’˜ ‚(:‡ èÔØ‹ü« gpu.0.gpu‚57.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚189.492' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚47.373 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Õg`™ ‚(:Õ èÔ‘¯˜­ disk.rbd0.out‚ 0.279296875 disk.sda.in‚ 53.73046875 disk.sdb2.out‚ 134.916015625 cpu‚25.514771617362847 proc.cpu.threads‚17 network.recv‚454386 disk.md0.in‚ 62.58984375 disk.nvme1n1.out‚5355.25 disk.sdb.in‚8.859375 disk.sdb.out‚ 134.916015625) proc.memory.percent‚19.31436061859131 disk.sdb2.in‚8.859375) disk./.usagePercent‚83.20999009848948 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 13311.8203125 disk.sda2.out‚ 134.916015625 disk.nvme0n1.in‚ 220.71875 network.sent‚ 1.932332e+06 disk.md0p1.out‚ 130.08203125 disk.rbd2.in‚0 disk.sda2.in‚ 53.73046875) proc.memory.availableMB‚ 5095.41015625 disk.sdb1.out‚0% disk./.usageGB‚2975.9922943115234 disk.md0.out‚ 130.08203125 disk.rbd2.out‚ 0.279296875 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125! disk.nvme0n1.out‚ 7956.5703125 disk.md0p1.in‚ 62.58984375 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sda.out‚ 134.916015625 disk.sda1.in‚0$ memory_percent‚68.90008449554443# proc.memory.rssMB‚ 3164.46484375ûI7n”š ‚(:‰ ¬èÔË­¸« gpu.0.gpu‚68.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚147.606' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚36.9015 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0«›Èj› ‚(:ß ¬èÔÕºï« network.sent‚ 1.937493e+06 disk.sdb1.in‚0" disk.nvme1n1.out‚ 5413.03515625 proc.cpu.threads‚17 disk.sdb2.out‚136.4052734375 disk.rbd2.in‚0 disk.md0p1.in‚ 62.58984375 disk.rbd0.out‚ 0.279296875 disk.sda1.out‚0% disk./.usageGB‚2976.0853729248047 disk.rbd0.in‚0" disk.nvme0n1.out‚ 8100.60546875 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚8.859375# proc.memory.rssMB‚ 3164.46484375 disk.rbd2.out‚ 0.279296875 network.recv‚457952 disk.md0.out‚ 131.50390625 disk.nvme0n1.in‚ 220.71875) proc.memory.percent‚19.31436061859131) disk./.usagePercent‚83.21259261547324 disk.md0p1.out‚ 131.50390625 disk.dm-0.out‚ 13513.640625 disk.sda.out‚136.4052734375 disk.sda2.out‚136.4052734375$ memory_percent‚68.90156269073486) proc.memory.availableMB‚ 5095.16796875 disk.md0.in‚ 62.58984375 disk.sda.in‚ 53.73046875 disk.sdb.out‚136.4052734375 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sdb2.in‚8.859375 disk.sda2.in‚ 53.73046875 cpu‚25.514033609392797 ÖÉ„2œ - _wandbruntime‚1199  _runtime‚1199‘n(]Å ¿ _runtime‚1199.003462008 _step‚85 & lr-AdamW/pg1‚0.0011719201881125857 & lr-AdamW/pg2‚0.0011719201881125857 trainer/global_step‚1099 $ _timestamp‚1.788479546892365e+09|æGUÉž à & lr-AdamW/pg2‚0.0011719201881125857 trainer/global_step‚1099 $ _timestamp‚1.788479546892365e+09 _runtime‚1199.003462008 _step‚85 & lr-AdamW/pg1‚0.0011719201881125857U~¡PÎ2Ÿ - _wandbruntime‚1199  _runtime‚1199á¼Þ‡  ãO H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1193944753152 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚127968275294208 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚12159853 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚150079323430912 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚150078522915840 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚5647913 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1189144745585 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚19619310 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1295949648896 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚148885361638400 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚147612355215253 _runtime‚ 1199.0061455 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1189926227461 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 % _timestamp‚1.7884795468947165e+09 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚43827646 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1296109891584 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160242688 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚129264410089472 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 trainer/global_step‚1099 ]IDeviceStatsMonªs‡Bbitor.on_train_batch_start/active_bytes.large_pool.allocated‚148885378677760 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚17807763 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚12159850 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚150078522915840 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1193161277440 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1193161277440 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚147612355215253 _runtime‚ 1199.0061455 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1189926227461 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 % _timestamp‚1.7884795468947165e+09 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚43827646 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1296109891584 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160242688 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚129264410089472 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 trainer/global_step‚1099 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚148885378677760 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚17807763 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚12159850 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚150078522915840 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1193161277440 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1193161277440 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1193944753152 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752V¾—1•¢ ‚(:Š »èԱǫ gpu.0.gpu‚71.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚133.349' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚33.33725 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ö­×b£ ‚(:× »èÔ³Á ­ disk.sdb2.in‚8.859375 disk.sdb2.out‚138.6650390625 disk.dm-0.out‚13845.56640625 disk.sda1.out‚0 disk.md0p1.out‚133.6875# proc.memory.rssMB‚ 3164.46484375) proc.memory.percent‚19.31436061859131% disk./.usageGB‚2976.2113723754883$ memory_percent‚68.90337467193604) proc.memory.availableMB‚ 5094.87109375) disk./.usagePercent‚83.21611561284922 disk.dm-0.in‚ 253.17578125" disk.nvme1n1.out‚ 5528.76171875 disk.sdb.out‚138.6650390625 disk.sda2.in‚ 53.73046875 network.recv‚462554 disk.sda.in‚ 53.73046875 disk.sda.out‚138.6650390625 cpu‚25.512994913094204 disk.sdb.in‚8.859375 disk.md0.in‚ 62.58984375 disk.md0.out‚133.6875 disk.sdb1.in‚0 network.sent‚ 1.95465e+06 disk.rbd0.out‚ 0.279296875 disk.rbd2.in‚0 disk.rbd2.out‚ 0.279296875! disk.nvme0n1.out‚ 8316.8046875 disk.nvme0n1.in‚ 220.71875 disk.sdb1.out‚0 disk.rbd0.in‚0 disk.sda2.out‚138.6650390625 proc.cpu.threads‚17 disk.sda1.in‚0 disk.md0p1.in‚ 62.58984375 disk.nvme1n1.in‚ 32.45703125:®+†2¤ - _wandbruntime‚1200  _runtime‚1200é‹[ïõ&¥ ïM FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚24230050 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚12170610 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚498 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚150213141094912 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1194227616256 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚19636760 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚129379710421504 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1297114579968 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚147743269640383 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1190988972995 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚43866812 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1190207490911 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚19636760 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚5652960 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚149018129989632 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚17823570 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚5653458 % _timestamp‚1.7884795479702368e+09 _runtime‚1200.082089076 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚150213141094912 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚146553062149472 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚24230050 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1194227616256 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚17824071 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚129379533677056 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151840768 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 _step‚87•WÍ_b¦ óM UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 _step‚87 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚24230050 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚12170610 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚498 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚150213141094912 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1194227616256 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚19636760 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚129379710421504 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1297114579968 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚147743269640383 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1190988972995 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977436672 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚43866812 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1190207490911 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚19636760 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚5652960 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚149018129989632 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚17823570 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚5653458 % _timestamp‚1.7884795479702368e+09 _runtime‚1200.082089076 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 Wȸí—CDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚150213141094912 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚146553062149472 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚24230050 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1194227616256 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚17824071 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚129379533677056 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151840768 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600WNÙ²Ì2§ - _wandbruntime‚1200  _runtime‚1200ÒðãZ¨ Ô 0loss/FRt1/assignment_loss‚1.5979838064036418 0loss/FRt3/assignment_loss‚3.5959776529899012 /loss/FRt4/assignment_loss‚3.935215951280391 %loss/total_loss‚45.20906489115259 0loss/FBt3/assignment_loss‚0.1333001633121105 /loss/FBt3/detection_loss‚2.3554005434638574 1loss/SRqqt3/assignment_loss‚2.052306727018385 2loss/SRqqt4/assignment_loss‚1.5667688583931592 epoch‚1 2loss/SRqqt1/assignment_loss‚0.8228173382086492 2loss/SRqqt2/assignment_loss‚1.8261161921545863 _runtime‚1200.083598101 0loss/SRqqt3/detection_loss‚2.445415694562216 _step‚88 .loss/FRt3/detection_loss‚2.796937605050894 1loss/SRqqt1/detection_loss‚0.9799789798339741 1loss/SRqqt2/detection_loss‚1.6709953452277386 0loss/SRqqt4/detection_loss‚2.301515453223941 1loss/FBt4/assignment_loss‚0.20973448122293287 /loss/FRt1/detection_loss‚1.6944964831483733 /loss/FRt4/detection_loss‚2.2474774931398955 /loss/FBt4/detection_loss‚3.1547498919747095 0loss/FRt2/assignment_loss‚3.4059762637336535 1loss/FBt1/assignment_loss‚0.19451857613209428 1loss/FBt2/assignment_loss‚0.27142449438243227 .loss/FRt2/detection_loss‚2.584642545356379 /loss/FBt1/detection_loss‚0.5571993875193847 .loss/FBt2/detection_loss‚2.808114963419297 trainer/global_step‚1099 % _timestamp‚1.7884795479734833e+09âÖ0^© Ø 1loss/SRqqt3/assignment_loss‚2.052306727018385 2loss/SRqqt4/assignment_loss‚1.5667688583931592 epoch‚1 2loss/SRqqt1/assignment_loss‚0.8228173382086492 2loss/SRqqt2/assignment_loss‚1.8261161921545863 _runtime‚1200.083598101 0loss/SRqqt3/detection_loss‚2.445415694562216 _step‚88 .loss/FRt3/detection_loss‚2.796937605050894 1loss/SRqqt1/detection_loss‚0.9799789798339741 1loss/SRqqt2/detection_loss‚1.6709953452277386 0loss/SRqqt4/detection_loss‚2.301515453223941 1loss/FBt4/assignment_loss‚0.20973448122293287 /loss/FRt1/detection_loss‚1.6944964831483733 /loss/FRt4/detection_loss‚2.2474774931398955 /loss/FBt4/detection_loss‚3.1547498919747095 0loss/FRt2/assignment_loss‚3.4059762637336535 1loss/FBt1/assignment_loss‚0.19451857613209428 1loss/FBt2/assignment_loss‚0.27142449438243227 .loss/FRt2/detection_loss‚2.584642545356379 /loss/FBt1/detection_loss‚0.5571993875193847 .loss/FBt2/detection_loss‚2.808114963419297 trainer/global_step‚1099 % _timestamp‚1.7884795479734833e+09 0loss/FRt1/assignment_loss‚1.5979838064036418 0loss/FRt3/assignment_loss‚3.5959776529899012 /loss/FRt4/assignment_loss‚3.935215951280391 %loss/total_loss‚45.20906489115259 0loss/FBt3/assignment_loss‚0.1333001633121105 /loss/FBt3/detection_loss‚2.3554005434638574X±–ó}ª ‚(:… ÊèԱ鈬 gpu.0.gpu‚1.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0«õX®d« ‚(:Ù ÊèÔ÷ªÆ¬ cpu‚25.512269783468437 proc.cpu.threads‚17 disk.sda.in‚ 53.73046875 disk.sdb.out‚140.31689453125! disk.sdb2.out‚140.31689453125 disk.md0p1.in‚ 62.58984375 disk.sda1.in‚0 disk.dm-0.in‚ 253.17578125 disk.rbd2.in‚0% disk./.usageGB‚2976.4613494873047 disk.sdb1.in‚0! disk.sda2.out‚140.31689453125 disk.rbd0.in‚0 network.recv‚467109 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.71875! disk.nvme0n1.out‚ 8388.8359375# proc.memory.rssMB‚ 3164.46484375 disk.sda.out‚140.31689453125 disk.sdb2.in‚8.859375) proc.memory.percent‚19.31436061859131) disk./.usagePercent‚83.22310507751916 disk.sda1.out‚0 disk.sda2.in‚ 53.73046875# memory_percent‚68.9021110534668 disk.dm-0.out‚ 13975.4609375 network.sent‚ 2.028864e+06 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚8.859375 disk.md0.in‚ 62.58984375 disk.md0.out‚ 135.2734375 disk.md0p1.out‚ 135.2734375 disk.rbd0.out‚ 0.279296875 disk.nvme1n1.out‚5586.625 disk.rbd2.out‚ 0.279296875' proc.memory.availableMB‚ 5095.078125&,¸ž’¬ ‚(:‡ ÙèÔ÷”úª gpu.0.gpu‚4.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚233.222' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.3055 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0”ãìP_­ ‚(:Ô ÙèÔ¿ñÇ«) proc.memory.availableMB‚ 5095.05859375 disk.sda2.out‚ 141.794921875 disk.sda.in‚ 53.73046875 disk.nvme0n1.in‚ 220.71875 disk.sdb.in‚8.859375 network.sent‚ 2.094815e+06 disk.sda1.in‚0) proc.memory.percent‚19.31436061859131 cpu‚25.51177107875567 disk.sda1.out‚0 network.recv‚472986 disk.rbd2.out‚ 0.279296875 disk.sdb1.in‚0 disk.sdb1.out‚0) disk./.usagePercent‚83.22310315762958 disk.rbd0.in‚0 disk.rbd0.out‚ 0.279296875 disk.nvme1n1.out‚ 5731.21875 disk.sdb2.out‚ 141.794921875 disk.md0p1.out‚ 136.69140625 disk.rbd2.in‚0 disk.sdb2.in‚8.859375# proc.memory.rssMB‚ 3164.46484375 disk.sda2.in‚ 53.73046875 disk.md0p1.in‚ 62.58984375 disk.dm-0.out‚ 14264.171875 proc.cpu.threads‚17 disk.nvme0n1.out‚ 8532.953125 disk.sdb.out‚ 141.794921875$ disk./.usageGB‚2976.461280822754 disk.md0.out‚ 136.69140625 disk.dm-0.in‚ 253.17578125 disk.sda.out‚ 141.794921875$ memory_percent‚68.90223026275635 disk.md0.in‚ 62.58984375 disk.nvme1n1.in‚ 32.45703125^H?ŽŸ® ‚(:” èèÔúºÈ« gpu.0.gpu‚61.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚207.152' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚51.788000000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0×Þ=b¯ ‚(:× èèÔˆ–â« disk.sda.out‚ 143.759765625 disk.sdb.out‚ 143.759765625) disk./.usagePercent‚83.22310315762958$ disk./.usageGB‚2976.461280822754 disk.rbd0.in‚0 disk.rbd2.out‚ 0.279296875 disk.nvme1n1.out‚ 5783.28125 disk.dm-0.out‚14452.30078125 disk.sdb1.in‚0# memory_percent‚68.9021348953247 proc.cpu.threads‚17 disk.dm-0.in‚ 253.17578125 disk.sdb2.out‚ 143.759765625 disk.nvme0n1.in‚ 220.71875" disk.nvme0n1.out‚ 8669.01953125 disk.nvme1n1.in‚ 32.45703125 disk.md0.out‚ 138.58203125 disk.sda.in‚ 53.73046875# proc.memory.rssMB‚ 3164.46484375 disk.rbd0.out‚ 0.279296875) proc.memory.percent‚19.31436061859131 disk.sdb2.in‚8.859375 network.sent‚ 2.099972e+06 disk.sda2.out‚ 143.759765625 disk.md0.in‚ 62.58984375 cpu‚25.51123469777703 disk.rbd2.in‚0 disk.sdb1.out‚0 network.recv‚476654 disk.sdb.in‚8.859375 disk.md0p1.in‚ 62.58984375) proc.memory.availableMB‚ 5095.07421875 disk.sda1.in‚0 disk.sda1.out‚0 disk.sda2.in‚ 53.73046875 disk.md0p1.out‚ 138.582031258“Óå2° - _wandbruntime‚1255  _runtime‚1255Ø9c·Æ± À & lr-AdamW/pg1‚0.0011668042399135719 & lr-AdamW/pg2‚0.0011668042399135719 trainer/global_step‚1149 % _timestamp‚1.7884796034406254e+09 _runtime‚1255.550914107 _step‚89P«¾kʲ Ä _step‚89 & lr-AdamW/pg1‚0.0011668042399135719 & lr-AdamW/pg2‚0.0011668042399135719 trainer/global_step‚1149 % _timestamp‚1.7884796034406254e+09 _runtime‚1255.550914107YLäJ¯2³ - _wandbruntime‚1255  _runtime‚1255‰uS¬ë'´ åO QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1354394375168 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚25296088 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚12697850 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚513 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚152954922000432 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚154197231184325 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884796034416819e+09 _runtime‚1255.555828159 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚155522927232000 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1354248812544 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚20491908 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚154198029705561 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚156769433278464 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚25272818 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 170466304 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚516 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚12697853 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚135029714250752 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1243090665769 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1246506046464 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚155522944271360 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚18599005 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚5900639 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚133675490341888 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚155522927232000 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚20491910 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚25296088 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚5901152 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚156769433278464 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 145562624 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚45764726 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚152954939039792 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚135029884717056 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚152954922000432 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚154197231184325 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884796034416819e+09 _runtime‚1255.555828159 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚155522927232000 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1354248812544 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚20491908 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚154198029705561 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚156769433278464 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚25272818 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 170466304 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚516 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚12697853 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚135029714250752 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1243090665769 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1246506046464 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚155522944271360 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977436672 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515072 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚18599005 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚5900639 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚133675490341888 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚155522927232000 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚20491910 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚25296088 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚5901152 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23272 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚156769433278464 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 145562624 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚45764726 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚152954939039792 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚135029884717056 ICDeviceStatsMonitor.on_train_batch_start/overl~Ô¥size_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475Z aAF2¶ - _wandbruntime‚1256  _runtime‚1256ïl1eô&· îM F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 _step‚91 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚18614736 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚156903250929152 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚154329742652135 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚5906123 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1355411988992 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚25294506 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚45827164 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚12708613 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1244153411303 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚153085589240832 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚45827164 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚25317802 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚155655695583232 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 $ _timestamp‚1.788479604287247e+09 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚156904051457536 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚156904051457536 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚133789609241088 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚18614224 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚153085572201472 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚155655678543872 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚155655678543872 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚20509362 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚12708610 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1247572385280 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚20509360 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚20509362 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚45803866 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1248355874304 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176744448 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚18614736 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚156903250929152 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚154329742652135 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚5906123 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1355411988992 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚25294506 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚45827164 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚12708613 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1244153411303 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚153085589240832 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚45827164 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚25317802 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚155655695583232 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 $ _timestamp‚1.788479604287247e+09 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482084 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚156904051457536 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚156904051457536 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚133789609241088 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚18614224 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚153085572201472 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23296 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚155655678543872 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚155655678543872 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚20509362 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚12708610 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1247572385280 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚20509360 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚20509362 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚45803866 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28431 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833[EÍÌý2¹ - _wandbruntime‚1256  _runtime‚1256ÈÕÄUº Ï .loss/FRt3/detection_loss‚2.797770205565861 _runtime‚1256.398904077 0loss/FRt1/assignment_loss‚1.5708391644737938 2loss/SRqqt4/assignment_loss‚1.5920293033123016 /loss/SRqqt4/detection_loss‚2.31101911076728 %loss/total_loss‚42.92660142142816 _step‚92 1loss/SRqqt1/detection_loss‚0.9405852450948694 1loss/FBt3/assignment_loss‚0.09632702082827903 -loss/FRt4/detection_loss‚2.12263533301965 0loss/SRqqt2/detection_loss‚1.808223826729733 /loss/FBt4/detection_loss‚2.5102447428201375 trainer/global_step‚1149 $ _timestamp‚1.788479604288894e+09 1loss/FBt4/assignment_loss‚0.22316886132964436 /loss/FBt2/detection_loss‚2.2192854207494985 /loss/FRt2/assignment_loss‚2.747931557042258 2loss/SRqqt2/assignment_loss‚1.7323695178022203 1loss/FBt1/assignment_loss‚0.11749124094303412 .loss/FRt1/detection_loss‚1.580002589015798 /loss/FBt1/detection_loss‚0.6089748221629087 0loss/FRt3/assignment_loss‚3.7066799598080773 /loss/FRt4/assignment_loss‚3.392798663365959 1loss/SRqqt3/assignment_loss‚1.741648606956005 1loss/FBt2/assignment_loss‚0.14929538810595303 2loss/SRqqt1/assignment_loss‚1.2258919238018384 /loss/FRt2/detection_loss‚2.4413427509270704 1loss/SRqqt3/detection_loss‚2.5224673606100536 -loss/FBt3/detection_loss‚2.76757880619594 epoch‚1µñY» Ó 1loss/FBt4/assignment_loss‚0.22316886132964436 /loss/FBt2/detection_loss‚2.2192854207494985 /loss/FRt2/assignment_loss‚2.747931557042258 2loss/SRqqt2/assignment_loss‚1.7323695178022203 1loss/FBt1/assignment_loss‚0.11749124094303412 .loss/FRt1/detection_loss‚1.580002589015798 /loss/FBt1/detection_loss‚0.6089748221629087 0loss/FRt3/assignment_loss‚3.7066799598080773 /loss/FRt4/assignment_loss‚3.392798663365959 1loss/SRqqt3/assignment_loss‚1.741648606956005 1loss/FBt2/assignment_loss‚0.14929538810595303 2loss/SRqqt1/assignment_loss‚1.2258919238018384 /loss/FRt2/detection_loss‚2.4413427509270704 1loss/SRqqt3/detection_loss‚2.5224673606100536 -loss/FBt3/detection_loss‚2.76757880619594 epoch‚1 .loss/FRt3/detection_loss‚2.797770205565861 _runtime‚1256.398904077 0loss/FRt1/assignment_loss‚1.5708391644737938 2loss/SRqqt4/assignment_loss‚1.5920293033123016 /loss/SRqqt4/detection_loss‚2.31101911076728 %loss/total_loss‚42.92660142142816 _step‚92 1loss/SRqqt1/detection_loss‚0.9405852450948694 1loss/FBt3/assignment_loss‚0.09632702082827903 -loss/FRt4/detection_loss‚2.12263533301965 0loss/SRqqt2/detection_loss‚1.808223826729733 /loss/FBt4/detection_loss‚2.5102447428201375 trainer/global_step‚1149 $ _timestamp‚1.788479604288894e+09\gIvŸ¼ ‚(:” ÷èÔ„ù“¬ gpu.0.gpu‚87.0 gpu.0.memory‚22, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚127.106' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚31.776499999999995 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ü-qk½ ‚(:à ÷èÔþÏ«¬ disk.sdb1.out‚0 disk.sda.out‚145.33349609375" disk.nvme0n1.out‚ 8817.55859375 disk.sdb.in‚8.859375) proc.memory.percent‚19.31436061859131 disk.rbd0.in‚0 disk.dm-0.out‚14693.79296875) disk./.usagePercent‚83.20330173650173 disk.rbd2.in‚0! disk.sdb2.out‚145.33349609375! disk.sda2.out‚145.33349609375# memory_percent‚68.9023494720459 disk.md0p1.out‚ 140.08984375 disk.sda1.out‚0 network.sent‚ 2.104179e+06$ disk./.usageGB‚2975.753086090088 disk.rbd2.out‚ 0.279296875 disk.sda.in‚ 53.73046875 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.out‚ 5876.234375( proc.memory.availableMB‚ 5095.0390625# proc.memory.rssMB‚ 3164.46484375 disk.sda2.in‚ 53.73046875 disk.md0p1.in‚ 62.58984375 disk.nvme1n1.in‚ 32.45703125 proc.cpu.threads‚17 disk.dm-0.in‚ 253.17578125 disk.sdb2.in‚8.859375 disk.sdb1.in‚0 disk.sda1.in‚0 disk.sdb.out‚145.33349609375 disk.md0.in‚ 62.58984375 disk.md0.out‚ 140.08984375 cpu‚25.510695326977626 network.recv‚480975 disk.rbd0.out‚ 0.279296875±¿T •¾ ‚(:Š †‘èÔòé« gpu.0.gpu‚72.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚43.0 gpu.0.powerWatts‚230.813' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.70325 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Á‰]¿ ‚(:Ò †‘èÔÞËã« disk.rbd2.in‚0 disk.sda.in‚ 53.73046875" disk.nvme0n1.out‚ 8938.83984375# memory_percent‚68.9044713973999 network.sent‚ 2.191939e+06 disk.md0p1.in‚ 62.58984375 disk.rbd2.out‚ 0.279296875 disk.sdb1.in‚0# proc.memory.rssMB‚ 3164.46484375 network.recv‚485683 disk.md0.in‚ 62.58984375 disk.md0.out‚ 141.59375 disk.dm-0.out‚14863.80078125 proc.cpu.threads‚17 disk.nvme0n1.in‚ 220.71875( disk./.usagePercent‚83.1786658200949 disk.rbd0.out‚ 0.279296875 disk.sda.out‚ 146.908203125 disk.sda1.in‚0 disk.sdb2.in‚8.859375 disk.sda2.in‚ 53.73046875 disk.md0p1.out‚ 141.59375 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125! disk.nvme1n1.out‚ 5924.9609375 disk.sdb2.out‚ 146.908203125 disk.dm-0.in‚ 253.17578125 disk.sdb.in‚8.859375) proc.memory.percent‚19.31436061859131 cpu‚25.510786468391956# disk./.usageGB‚2974.87198638916 disk.rbd0.in‚0 disk.sda1.out‚0 disk.sdb.out‚ 146.908203125 disk.sda2.out‚ 146.908203125) proc.memory.availableMB‚ 5094.691406254±4‚’À ‚(:‡ •‘èÔ¿ä׫ gpu.0.gpu‚46.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚226.37' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.5925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0³–°bÁ ‚(:× •‘èÔéŒñ« disk.rbd0.out‚ 0.279296875 disk.sdb2.out‚148.5419921875% disk./.usageGB‚2974.8599433898926 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.nvme0n1.out‚ 8939.015625 disk.sdb.out‚148.5419921875 disk.md0.in‚ 62.58984375 disk.nvme1n1.out‚ 5925.765625 disk.md0p1.in‚ 62.58984375 disk.md0p1.out‚ 143.16015625 disk.sda.in‚ 53.73046875# memory_percent‚68.9044713973999 network.recv‚490669 disk.rbd0.in‚0# proc.memory.rssMB‚ 3164.46484375) proc.memory.percent‚19.31436061859131 disk.sdb.in‚8.859375 disk.sda2.in‚ 53.73046875 disk.dm-0.in‚ 253.17578125 proc.cpu.threads‚17 disk.rbd2.out‚ 0.279296875 disk.sdb1.in‚0 disk.md0.out‚ 143.16015625 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 cpu‚25.510660345540128 disk.sdb2.in‚8.859375 network.sent‚ 2.196417e+06' disk./.usagePercent‚83.178329092795 disk.sdb1.out‚0) proc.memory.availableMB‚ 5094.69140625 disk.sda2.out‚148.5419921875 disk.dm-0.out‚ 14864.78125 disk.rbd2.in‚0 disk.sda.out‚148.5419921875Ù—1Ö2 - _wandbruntime‚1303  _runtime‚1303âaRÅà ¿ & lr-AdamW/pg1‚0.0011612134744403348 & lr-AdamW/pg2‚0.0011612134744403348 trainer/global_step‚1199 $ _timestamp‚1.788479650989733e+09 _runtime‚1303.102964468 _step‚93Ò’—ÉÄ Ã _runtime‚1303.102964468 _step‚93 & lr-AdamW/pg1‚0.0011612134744403348 & lr-AdamW/pg2‚0.0011612134744403348 trainer/global_step‚1199 $ _timestamp‚1.788479650989733e+09]"V[Ì2Å - _wandbruntime‚1303  _runtime‚1303^<«üýÆ äO WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚159487449091792 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚163460343641088 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚19389870 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1300634291200 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚21364508 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚47748350 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚139382680485888 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1295473622201 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚26360570 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚13235853 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚26383840 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚140795294295552 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174660608 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884796509906173e+09 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚163461144156160 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚162160492825600 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚6154017 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149756928 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚1199 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚162160509864960 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 _step‚94 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚6153504 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚163460343641088 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚162160492825600 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚139382655582208 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1299850815488 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1296255104077 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚19389354 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚21364510 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1412464052736 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚47725078 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1300634291200 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0ö-¼2î'Ç èO P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941487616 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚162160509864960 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚160782905674633 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420784 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1299850815488 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1412613809664 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941487616 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515072 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚26360570 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚513 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481876 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚516 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚163461144156160 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚26383840 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28164 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1300634291200 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977436672 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚21364508 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚47748350 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚139382680485888 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1295473622201 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104833 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚26360570 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28431 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚13235853 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚26383840 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚140795294295552 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174660608 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884796509906173e+09 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚163461144156160 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚162160492825600 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚6154017 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149756928 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚1199 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚162160509864960 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 _step‚94 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783475712 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚6153504 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚163460343641088 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚162160492825600 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚139382655582208 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 263636480 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783475712 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1299850815488 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23272 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1296255104077 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28431 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚19389354 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚21364510 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28164 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1412464052736 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚47725078 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1300634291200 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23270 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521236 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚159487449091792 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚163460343641088 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23270 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚19389870 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚19405146 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚21381962 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚19405670 _step‚95 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚524 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚26382258 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚162293261176832 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚140910420626944 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚21381962 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚47764218 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚139496824288768 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚47787516 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178841600 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚47787516 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1301700643328 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 $ _timestamp‚1.788479651850789e+09 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚162293244137472 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚13246610 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚159618099292832 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1297317849611 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1413621241856 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚160915417142443 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 trainer/global_step‚1199 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚47764218 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚26405554 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚162293244137472Äé{ÜÊ òM ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28431 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚163594961820160 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚21381960 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚140910599468544 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 263636480 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚162293261176832 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚19405146 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚21381962 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941487616 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28164 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420784 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941487616 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚19405670 _step‚95 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚524 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚26382258 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚162293261176832 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚140910420626944 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚21381962 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528384 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489024 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚47764218 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚139496824288768 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚47787516 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178841600 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚47787516 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1301700643328 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489024 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 $ _timestamp‚1.788479651850789e+09 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚162293244137472 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23296 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚13246610 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚159618099292832 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1297317849611 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1413621241856 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521444 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104833 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23298 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528384 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚160915417142443 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 trainer/global_step‚1199 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚47764218 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚26405554 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚162293244137472 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚26382258 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚6158536 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977436672 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚521 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WGDeviceStatsMonitor.on_train_batch_end/reserve"*˜ d_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚163594961820160 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1296536367527 F&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 +jet/accuracy_2_of_5‚0.45777490735054016 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.5833333134651184 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.3973797559738159 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 6 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.899177074432373 8"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.392879456281662 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 jet/accuracy_1_of_7‚1 particle/accuracy_1_of_7‚1 particle/accuracy_3_of_7‚1 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2315312922000885 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 7 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.2766502797603607 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.4222089946269989 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.21568627655506134 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.2916666567325592 ) Purity/1FRt1SRqqt3FBt/FRt_purity‚0.25 ("Purity/2FRt0SRqqt2FBt/event_purity‚0 ("Purity/3FRt*SRqqt*FBt/event_purity‚0 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.25308528542518616 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.19241079688072205 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.5182795524597168 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4299745261669159 particle/accuracy_1_of_5‚1 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.4528176784515381 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9878724813461304 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3753623366355896 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.014793861657381058 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.39714983105659485 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 7 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.4912281036376953 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9988052845001221 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.5090579986572266 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.3991100490093231 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 ( Purity/*FRt0SRqqt3FBt/FRt_purity‚0.5 :"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.48510411381721497 8 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.47261905670166016 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4357006549835205 particle/accuracy_2_of_5‚1 particle/accuracy_4_of_5‚1 particle/accuracy_6_of_6‚1 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.009371242485940456 particle/accuracy_5_of_5‚1 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.07399117201566696 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5448156595230103 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.2666666805744171 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 7 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.2965409755706787 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 jet/accuracy_6_of_6‚0 particle/accuracy_4_of_7‚1 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9964157938957214 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.33245906233787537 ;"Purity/2FRt*SRqqt1FBt/event_purity‚0.018313255161046982 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.08045977354049683 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 particle/accuracy_3_of_5‚1 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ( Purity/1FRt*SRqqt3FBt/FRt_purity‚0.5 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.17706908285617828 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.2481481432914734 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 particle/accuracy_5_of_6‚1 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 ("Purity/1FRt0SRqqt3FBt/event_purity‚0 :"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.31084659695625305 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 *jet/accuracy_1_of_3‚0.8673211932182312 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.29034045338630676 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9927709698677063 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.3937200903892517 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.5000000596046448 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 jet/accuracy_3_of_7‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.01832713931798935 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6502231955528259 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9693518280982971 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.028801843523979187 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.2948051691055298 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9960246086120605 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 *jet/accuracy_1_of_4‚0.9050238728523254 ."Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.28125 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9114943146705627 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.40431419014930725 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 7 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.2577380836009979 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7149122357368469 +"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.25 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 particle/accuracy_5_of_7‚1 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 *"Purity/4FRt2SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9970951676368713 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.44029149413108826 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.5635055303573608 9"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.8999999761581421 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9825834035873413 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.4332967698574066 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4028061032295227 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.28125 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3310372829437256 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.3620584011077881 ("Purity/3FRt*SRqqt1FBt/event_purity‚0 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.26923075318336487 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 particle/accuracy_2_of_7‚1 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 trainer/global_step‚1207 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 +particle/sensitivity‚0.3333427309989929 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 6 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.800000011920929 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3349206745624542 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1732577532529831 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.22667893767356873 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3005050718784332 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.26695528626441956 *jet/accuracy_2_of_4‚0.3473268747329712 particle/accuracy_2_of_6‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19970224797725677 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5507914423942566 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1071428656578064 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.23644977807998657 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.5833333134651184 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.5008447766304016 ) Purity/3FRt1SRqqt2FBt/FRt_purity‚0.25 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9929596781730652 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5347813963890076 6 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.352507621049881 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6181122064590454 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.006451612804085016 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.41613081097602844 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.3888888955116272 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8256900906562805 :"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.38861018419265747 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 particle/accuracy_1_of_6‚1 & Purity/*FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.2100466638803482 particle/accuracy_3_of_3‚1 +"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.75 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 & Purity/1FRt2SRqqt*FBt/FBt_purity‚1 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 jet/accuracy_5_of_5‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9897821545600891 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 particle/accuracy_1_of_4‚1 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5545340776443481 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 epoch‚1 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.22081540524959564 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4424442648887634 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.4523809850215912 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9883739948272705 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6912811994552612 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.20382779836654663 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4294871985912323 particle/accuracy_2_of_2‚1 particle/accuracy_2_of_3‚1 particle/accuracy_6_of_7‚1 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.3644755482673645 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 9"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.8999999761581421 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.37027648091316223 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 +"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.75 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5002744793891907 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2575332224369049 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.18518517911434174 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 ,jet/accuracy_4_of_5‚0.011827956885099411 jet/accuracy_2_of_6‚0.5 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9993913769721985 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.2874673306941986 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9266667366027832 ("Purity/1FRt*SRqqt3FBt/event_purity‚0 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 ( Purity/2FRt4SRqqt*FBt/FRt_purity‚0.5 ( Purity/1FRt4SRqqt*FBt/FRt_purity‚0.5 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.2924231290817261 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2250833958387375 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4520396292209625 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 7 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.2559155523777008 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9809972047805786 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4378264546394348 9"Purity/0FRt*SRqqt3FBt/event_purity‚0.1358024775981903 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7511307597160339 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 ( Purity/1FRt0SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 + Purity/4FRt*SRqqt0FBt/FRt_purity‚0.1875 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.23157824575901031 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.4588109254837036 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9995864033699036 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.20089949667453766 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 *jet/accuracy_1_of_5‚0.9423564076423645 jet/accuracy_4_of_7‚0 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 & Purity/1FRt2SRqqt1FBt/FBt_purity‚1 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 9"Purity/*£ûÇCFRt2SRqqt2FBt/SRqqt_purity‚0.4561403691768646 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 6 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.280727744102478 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 *"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.5 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.3095238208770752 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9882494807243347 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.5769230723381042 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 *"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.5 *"Purity/4FRt2SRqqt*FBt/SRqqt_purity‚0.5 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2654564380645752 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.29935944080352783 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.5190740823745728 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 6validation_average_jet_accuracy‚0.4277555048465729 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 :"Purity/*FRt2SRqqt0FBt/event_purity‚0.02002878673374653 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5100971460342407 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.4746287167072296 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3499771058559418 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.032670021057128906 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5734920501708984 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 (particle/f_score‚0.39587780833244324 ) Purity/4FRt2SRqqt*FBt/FRt_purity‚0.25 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04784420505166054 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.3333333432674408 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.39768537878990173 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.29472610354423523 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.6055555939674377 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.4000000059604645 particle/accuracy_7_of_7‚1 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.24328406155109406 :"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.42124611139297485 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ( Purity/*FRt*SRqqt3FBt/FRt_purity‚0.5 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.26882585883140564 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.22779960930347443 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.44069546461105347 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.21064816415309906 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9866877794265747 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.3087984323501587 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.3194444477558136 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5339208841323853 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5168886780738831 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3910094201564789 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9838894009590149 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2774082124233246 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 *jet/accuracy_2_of_3‚0.2459489107131958 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 particle/accuracy_1_of_3‚1 & Purity/1FRt2SRqqt2FBt/FBt_purity‚1 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 % _timestamp‚1.7884797013612523e+09 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 <"Purity/2FRt*SRqqt0FBt/event_purity‚0.0031283951830118895 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 _step‚97 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.36934179067611694 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 :"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.43788278102874756 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.16038623452186584 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9922457337379456 ( Purity/2FRt4SRqqt0FBt/FRt_purity‚0.5 & Purity/0FRt0SRqqt1FBt/FBt_purity‚1 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.23330678045749664 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 6 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.138888880610466 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.5769230723381042 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.20893128216266632 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4656803607940674 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.10827284306287766 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9375000596046448 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2692096531391144 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 +jet/accuracy_3_of_5‚0.08596673607826233 ( Purity/1FRt4SRqqt0FBt/FRt_purity‚0.5 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.4523809850215912 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.05132845789194107 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 jet/accuracy_5_of_7‚0 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9863051772117615 7 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.2513912320137024 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5121527910232544 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5151678323745728 particle/accuracy_2_of_4‚1 + Purity/4FRt*SRqqt*FBt/FRt_purity‚0.1875 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9956989288330078 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.23931561410427094 ("Purity/3FRt0SRqqt*FBt/event_purity‚0 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3333333432674408 5 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.58665931224823 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 *jet/accuracy_3_of_6‚0.2017543911933899 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9212302565574646 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22746945917606354 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.36666667461395264 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4214085340499878 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4783950448036194 +jet/accuracy_2_of_2‚0.11182762682437897 particle/accuracy_3_of_4‚1 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.3095238208770752 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.045266326516866684 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.11293651908636093 8"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.489955872297287 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.4898809492588043 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9897421598434448 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11818847805261612 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.4295552968978882 ("Purity/0FRt0SRqqt1FBt/event_purity‚1 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 9"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.4043140113353729 :"Purity/1FRt1SRqqt*FBt/event_purity‚0.02114550583064556 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 8"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.557692289352417 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ("Purity/3FRt0SRqqt1FBt/event_purity‚0 jet/accuracy_5_of_6‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.44029149413108826 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4370121657848358 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.34355154633522034 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 +jet/accuracy_4_of_6‚0.05263157933950424 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt*SRqqt2FBt/event_purity‚0 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.6973684430122375 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.05251330882310867 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.29285717010498047 :"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.42271724343299866 jet/accuracy_7_of_7‚0 ) Purity/4FRt2SRqqt0FBt/FRt_purity‚0.25 8 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.49118396639823914 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9791666269302368 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.39525318145751953 :"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.43333330750465393 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 jet/accuracy_1_of_6‚1 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt0SRqqt3FBt/event_purity‚0.1666666567325592 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.23892457783222198 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2729547321796417 ;"Purity/2FRt0SRqqt1FBt/event_purity‚0.035185184329748154 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 (particle/accuracy‚0.8411460518836975 particle/accuracy_3_of_6‚1 jet/accuracy_2_of_7‚0.5 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 ) Purity/*FRt1SRqqt3FBt/FRt_purity‚0.25 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.33640897274017334 6 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.983711838722229 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 9"Purity/1FRt0SRqqt0FBt/event_purity‚0.2100466638803482 :"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.41943100094795227 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.2053140103816986 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 8"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.479497492313385 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 6 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.287863165140152 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4571395814418793 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3464761972427368 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 +particle/specificity‚0.9351528286933899 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.2734375 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.19814418256282806 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09425841271877289 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3446969985961914 +jet/accuracy_1_of_1‚0.46719974279403687 )loss/val_total_loss‚43.74534996209766 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5443108677864075 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.013141204603016376 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.006066347472369671 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 jet/accuracy_4_of_4‚0 6 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.979211688041687 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.34479400515556335 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 _runtime‚ 1353.47418538 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9981338977813721 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3059011995792389 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.28199997544288635 particle/accuracy_1_of_2‚1 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.5000000596046448 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 jet/accuracy_6_of_7‚0”œ8×<Ø ¥ ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.3333333432674408 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.39768537878990173 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.29472610354423523 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.6055555939674377 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.4000000059604645 particle/accuracy_7_of_7‚1 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.24328406155109406 :"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.42124611139297485 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ( Purity/*FRt*SRqqt3FBt/FRt_purity‚0.5 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.26882585883140564 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.22779960930347443 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.44069546461105347 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.21064816415309906 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9866877794265747 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.3087984323501587 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.3194444477558136 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5339208841323853 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5168886780738831 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3910094201564789 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9838894009590149 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2774082124233246 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 *jet/accuracy_2_of_3‚0.2459489107131958 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 particle/accuracy_1_of_3‚1 & Purity/1FRt2SRqqt2FBt/FBt_purity‚1 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 % _timestamp‚1.7884797013612523e+09 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 <"Purity/2FRt*SRqqt0FBt/event_purity‚0.0031283951830118895 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 _step‚97 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.36934179067611694 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 :"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.43788278102874756 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.16038623452186584 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9922457337379456 ( Purity/2FRt4SRqqt0FBt/FRt_purity‚0.5 & Purity/0FRt0SRqqt1FBt/FBt_purity‚1 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.23330678045749664 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 6 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.138888880610466 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.5769230723381042 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.20893128216266632 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4656803607940674 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.10827284306287766 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9375000596046448 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2692096531391144 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 +jet/accuracy_3_of_5‚0.08596673607826233 ( Purity/1FRt4SRqqt0FBt/FRt_purity‚0.5 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.4523809850215912 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.05132845789194107 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 jet/accuracy_5_of_7‚0 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9863051772117615 7 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.2513912320137024 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5121527910232544 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5151678323745728 particle/accuracy_2_of_4‚1 + Purity/4FRt*SRqqt*FBt/FRt_purity‚0.1875 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9956989288330078 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.23931561410427094 ("Purity/3FRt0SRqqt*FBt/event_purity‚0 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3333333432674408 5 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.58665931224823 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 *jet/accuracy_3_of_6‚0.2017543911933899 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9212302565574646 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22746945917606354 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.36666667461395264 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4214085340499878 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4783950448036194 +jet/accuracy_2_of_2‚0.11182762682437897 particle/accuracy_3_of_4‚1 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.3095238208770752 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.045266326516866684 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.11293651908636093 8"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.489955872297287 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.4898809492588043 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9897421598434448 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11818847805261612 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.4295552968978882 ("Purity/0FRt0SRqqt1FBt/event_purity‚1 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 9"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.4043140113353729 :"Purity/1FRt1SRqqt*FBt/event_purity‚0.02114550583064556 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 8"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.557692289352417 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ("Purity/3FRt0SRqqt1FBt/event_purity‚0 jet/accuracy_5_of_6‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.44029149413108826 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4370121657848358 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.34355154633522034 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 +jet/accuracy_4_of_6‚0.05263157933950424 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt*SRqqt2FBt/event_purity‚0 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.6973684430122375 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.05251330882310867 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.29285717010498047 :"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.42271724343299866 jet/accuracy_7_of_7‚0 ) Purity/4FRt2SRqqt0FBt/FRt_purity‚0.25 8 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.49118396639823914 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9791666269302368 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.39525318145751953 :"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.43333330750465393 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 jet/accuracy_1_of_6‚1 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt0SRqqt3FBt/event_purity‚0.1666666567325592 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.23892457783222198 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2729547321796417 ;"Purity/2FRt0SRqqt1FBt/event_purity‚0.035185184329748154 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 (particle/accuracy‚0.8411460518836975 particle/accuracy_3_of_6‚1 jet/accuracy_2_of_7‚0.5 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 ) Purity/*FRt1SRqqt3FBt/FRt_purity‚0.25 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.33640897274017334 6 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.983711838722229 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 9"Purity/1FRt0SRqqt0FBt/event_purity‚0.2100466638803482 :"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.41943100094795227 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.2053140103816986 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 8"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.479497492313385 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 6 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.287863165140152 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4571395814418793 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3464761972427368 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 +particle/specificity‚0.9351528286933899 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.2734375 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.19814418256282806 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09425841271877289 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3446969985961914 +jet/accuracy_1_of_1‚0.46719974279403687 )loss/val_total_loss‚43.74534996209766 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5443108677864075 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.013141204603016376 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.006066347472369671 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 jet/accuracy_4_of_4‚0 6 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.979211688041687 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.34479400515556335 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 _runtime‚ 1353.47418538 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9981338977813721 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3059011995792389 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.28199997544288635 particle/accuracy_1_of_2‚1 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.5000000596046448 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 jet/accuracy_6_of_7‚0 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8730158805847168 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.2916666567325592 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.4146844446659088 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9930614829063416 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 8 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.47888892889022827 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.39754220843315125 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9765614867210388 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.07531746476888657 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4983465373516083 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0011520737316¨8Ï"¿U459417 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.015914563089609146 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 ,jet/accuracy_3_of_3‚0.025334641337394714 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 +jet/accuracy_2_of_5‚0.45777490735054016 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.5833333134651184 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.3973797559738159 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 6 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.899177074432373 8"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.392879456281662 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 jet/accuracy_1_of_7‚1 particle/accuracy_1_of_7‚1 particle/accuracy_3_of_7‚1 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2315312922000885 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 7 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.2766502797603607 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.4222089946269989 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.21568627655506134 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.2916666567325592 ) Purity/1FRt1SRqqt3FBt/FRt_purity‚0.25 ("Purity/2FRt0SRqqt2FBt/event_purity‚0 ("Purity/3FRt*SRqqt*FBt/event_purity‚0 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.25308528542518616 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.19241079688072205 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.5182795524597168 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4299745261669159 particle/accuracy_1_of_5‚1 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.4528176784515381 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9878724813461304 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3753623366355896 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.014793861657381058 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.39714983105659485 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 7 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.4912281036376953 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9988052845001221 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.5090579986572266 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.3991100490093231 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 ( Purity/*FRt0SRqqt3FBt/FRt_purity‚0.5 :"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.48510411381721497 8 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.47261905670166016 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4357006549835205 particle/accuracy_2_of_5‚1 particle/accuracy_4_of_5‚1 particle/accuracy_6_of_6‚1 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.009371242485940456 particle/accuracy_5_of_5‚1 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.07399117201566696 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5448156595230103 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.2666666805744171 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 7 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.2965409755706787 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 jet/accuracy_6_of_6‚0 particle/accuracy_4_of_7‚1 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9964157938957214 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.33245906233787537 ;"Purity/2FRt*SRqqt1FBt/event_purity‚0.018313255161046982 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.08045977354049683 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 particle/accuracy_3_of_5‚1 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ( Purity/1FRt*SRqqt3FBt/FRt_purity‚0.5 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.17706908285617828 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.2481481432914734 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 particle/accuracy_5_of_6‚1 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 ("Purity/1FRt0SRqqt3FBt/event_purity‚0 :"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.31084659695625305 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 *jet/accuracy_1_of_3‚0.8673211932182312 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.29034045338630676 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9927709698677063 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.3937200903892517 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.5000000596046448 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 jet/accuracy_3_of_7‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.01832713931798935 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6502231955528259 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9693518280982971 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.028801843523979187 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.2948051691055298 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9960246086120605 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 *jet/accuracy_1_of_4‚0.9050238728523254 ."Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.28125 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9114943146705627 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.40431419014930725 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 7 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.2577380836009979 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7149122357368469 +"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.25 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 particle/accuracy_5_of_7‚1 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 *"Purity/4FRt2SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9970951676368713 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.44029149413108826 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.5635055303573608 9"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.8999999761581421 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9825834035873413 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.4332967698574066 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4028061032295227 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.28125 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3310372829437256 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.3620584011077881 ("Purity/3FRt*SRqqt1FBt/event_purity‚0 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.26923075318336487 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 particle/accuracy_2_of_7‚1 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 trainer/global_step‚1207 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 +particle/sensitivity‚0.3333427309989929 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 6 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.800000011920929 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3349206745624542 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1732577532529831 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.22667893767356873 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3005050718784332 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.26695528626441956 *jet/accuracy_2_of_4‚0.3473268747329712 particle/accuracy_2_of_6‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19970224797725677 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5507914423942566 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1071428656578064 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.23644977807998657 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.5833333134651184 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.5008447766304016 ) Purity/3FRt1SRqqt2FBt/FRt_purity‚0.25 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9929596781730652 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5347813963890076 6 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.352507621049881 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6181122064590454 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.006451612804085016 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.41613081097602844 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.3888888955116272 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8256900906562805 :"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.38861018419265747 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 particle/accuracy_1_of_6‚1 & Purity/*FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.2100466638803482 particle/accuracy_3_of_3‚1 +"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.75 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 & Purity/1FRt2SRqqt*FBt/FBt_purity‚1 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 jet/accuracy_5_of_5‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9897821545600891 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 particle/accuracy_1_of_4‚1 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5545340776443481 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 epoch‚1 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.22081540524959564 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4424442648887634 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.4523809850215912 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9883739948272705 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6912811994552612 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.20382779836654663 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4294871985912323 particle/accuracy_2_of_2‚1 particle/accuracy_2_of_3‚1 particle/accuracy_6_of_7‚1 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.3644755482673645 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 9"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.8999999761581421 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.37027648091316223 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 +"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.75 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5002744793891907 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2575332224369049 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.18518517911434174 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 ,jet/accuracy_4_of_5‚0.011827956885099411 jet/accuracy_2_of_6‚0.5 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9993913769721985 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.2874673306941986 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9266667366027832 ("Purity/1FRt*SRqqt3FBt/event_purity‚0 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 ( Purity/2FRt4SRqqt*FBt/FRt_purity‚0.5 ( Purity/1FRt4SRqqt*FBt/FRt_purity‚0.5 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.2924231290817261 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2250833958387375 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4520396292209625 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 7 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.2559155523777008 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9809972047805786 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4378264546394348 9"Purity/0FRt*SRqqt3FBt/event_purity‚0.1358024775981903 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7511307597160339 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 ( Purity/1FRt0SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 + Purity/4FRt*SRqqt0FBt/FRt_purity‚0.1875 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.23157824575901031 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.4588109254837036 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9995864033699036 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.20089949667453766 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 *jet/accuracy_1_of_5‚0.9423564076423645 jet/accuracy_4_of_7‚0 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 & Purity/1FRt2SRqqt1FBt/FBt_purity‚1 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.4561403691768646 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 6 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.280727744102478 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 *"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.5 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.3095238208770752 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9882494807243347 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.5769230723381042 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 *"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.5 *"Purity/4FRt2SRqqt*FBt/SRqqt_purity‚0.5 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2654564380645752 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.29935944080352783 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.5190740823745728 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 6validation_average_jet_accuracy‚0.4277555048465729 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 :"Purity/*FRt2SRqqt0FBt/event_purity‚0.02002878673374653 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5100971460342407 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.4746287167072296 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3499771058559418 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.032670021057128906 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5734920501708984 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 (particle/f_score‚0.39587780833244324 ) Purity/4FRt2SRqqt*FBt/FRt_purity‚0.25 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04784420505166054a!$•Ù ‚(:Š à‘èÔ±þª gpu.0.gpu‚68.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚123.095' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.77375 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0§iX fÚ ‚(:Û à‘èÔܲª¬ disk.sda.out‚157.06982421875' proc.memory.availableMB‚ 4518.890625 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125 disk.sda1.in‚0" disk.nvme0n1.out‚ 9902.94140625 disk.sda2.in‚ 53.73046875 disk.rbd0.in‚0 proc.cpu.threads‚17 network.recv‚511801$ disk./.usageGB‚2976.009250640869" disk.nvme1n1.out‚ 6112.35546875 disk.rbd0.out‚ 0.279296875 disk.rbd2.out‚ 0.279296875 disk.sdb1.out‚0! disk.sda2.out‚157.06982421875 disk.md0p1.in‚ 62.58984375* proc.memory.percent‚19.361162185668945 cpu‚25.66795527308379 disk.sdb.out‚157.06982421875 disk.md0.in‚ 62.58984375 disk.md0p1.out‚ 151.390625 disk.rbd2.in‚0 network.sent‚ 2.305539e+06) disk./.usagePercent‚83.21046420455477 disk.sdb2.in‚8.859375! disk.sdb2.out‚157.06982421875 disk.dm-0.out‚ 16015.296875 disk.sda.in‚ 53.73046875 disk.sda1.out‚0 disk.sdb.in‚8.859375 disk.md0.out‚ 151.390625 disk.dm-0.in‚ 253.17578125$ memory_percent‚72.41888046264648" proc.memory.rssMB‚ 3172.1328125 disk.sdb1.in‚0Í›´mœÛ ‚(:‘ ï‘èÔÙ‡‰« gpu.0.gpu‚79.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚236.1' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚59.02499999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚06çØ`Ü ‚(:Õ ï‘èÔµŽ²«$ disk./.usageGB‚2976.015182495117 disk.sdb1.in‚0 disk.sda.in‚ 53.73046875 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.out‚ 16102.375 cpu‚25.66603577003103 proc.cpu.threads‚17 disk.rbd0.in‚0 disk.sda2.in‚ 53.73046875 network.recv‚517274 disk.nvme0n1.in‚ 220.71875 disk.sdb.in‚8.859375 disk.md0p1.in‚ 62.58984375 disk.rbd2.out‚ 0.279296875" disk.nvme1n1.out‚ 6112.58203125 disk.sdb2.in‚8.859375* proc.memory.percent‚19.361162185668945 disk.sda.out‚158.4697265625 disk.sda2.out‚158.4697265625 disk.md0p1.out‚ 152.734375$ memory_percent‚72.42045402526855" proc.memory.rssMB‚ 3172.1328125) disk./.usagePercent‚83.21063006168221 disk.sdb1.out‚0 disk.sda1.in‚0" disk.nvme0n1.out‚ 9989.79296875 disk.sdb.out‚158.4697265625 disk.md0.in‚ 62.58984375 disk.md0.out‚ 152.734375 network.sent‚ 2.407649e+06 disk.sda1.out‚0 disk.sdb2.out‚158.4697265625 disk.dm-0.in‚ 253.17578125 disk.rbd0.out‚ 0.279296875 disk.rbd2.in‚0( proc.memory.availableMB‚ 4518.6328125›ÞŸÝ ‚(:” þ‘èÔƒžùª gpu.0.gpu‚61.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚234.211' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚58.552749999999996 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0á ™nÞ ‚(:ã þ‘è԰麫 disk.sdb.in‚8.859375 disk.nvme1n1.in‚ 32.45703125 network.sent‚ 2.412704e+06 disk.rbd0.out‚ 0.279296875 disk.nvme0n1.in‚ 220.71875$ memory_percent‚72.42217063903809( proc.memory.availableMB‚ 4518.3515625* proc.memory.percent‚19.361162185668945 proc.cpu.threads‚17 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda.in‚ 53.73046875 disk.sda1.in‚0" disk.nvme0n1.out‚ 10669.9140625" disk.nvme1n1.out‚ 6118.65234375 network.recv‚520883) disk./.usagePercent‚83.21056627868401 disk.sda2.in‚ 53.73046875 disk.md0.in‚ 62.58984375 disk.md0p1.in‚ 62.58984375 disk.sdb.out‚160.25439453125% disk./.usageGB‚2976.0129013061523 disk.sdb2.in‚8.859375 disk.dm-0.in‚ 253.17578125 disk.sda1.out‚0 cpu‚25.66429305080168 disk.dm-0.out‚16788.56640625 disk.rbd2.out‚ 0.279296875" proc.memory.rssMB‚ 3172.1328125! disk.sdb2.out‚160.25439453125! disk.sda2.out‚160.25439453125 disk.md0.out‚ 154.44140625 disk.md0p1.out‚ 154.44140625 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sda.out‚160.25439453125§Çèì2ß - _wandbruntime‚1399  _runtime‚1399g‰XøÅà ¿ & lr-AdamW/pg1‚0.0011551525595968435 & lr-AdamW/pg2‚0.0011551525595968435 trainer/global_step‚1249 $ _timestamp‚1.788479746988284e+09 _runtime‚1399.098537914 _step‚98â–ÄÉá à & lr-AdamW/pg1‚0.0011551525595968435 & lr-AdamW/pg2‚0.0011551525595968435 trainer/global_step‚1249 $ _timestamp‚1.788479746988284e+09 _runtime‚1399.098537914 _step‚98bãQà2â - _wandbruntime‚1399  _runtime‚1399âj·Ì÷ã äO LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1368945045315 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚171615044723712 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚171615044723712 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚522 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 _step‚99 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚172987814300672 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚170053956309371 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1373553053184 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚525 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1372769576960 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚22650030 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚172988614816256 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚147440821285888 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚171615061763072 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1368163563435 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 _runtime‚ 1399.09984773 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚14095571 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚14095568 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158145024 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 trainer/global_step‚1249 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚50360066 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚171615061763072 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚172988614816256 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚148931253788672 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚20626052 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚168685809785296 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚22650028 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚168685792745936 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚22650028 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚27710038 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1490590647808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1490432502784 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚22650030 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3AŠÌ î'ä èO ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1368163563435 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 _runtime‚ 1399.09984773 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚14095571 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚14095568 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158145024 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 trainer/global_step‚1249 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚50360066 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚171615061763072 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚172988614816256 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚148931253788672 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚20626052 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚168685809785296 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚22650028 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚168685792745936 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚22650028 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚27710038 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1490590647808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1490432502784 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚22650030 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1368945045315 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚171615044723712 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚171615044723712 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚522 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 _step‚99 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚172987814300672 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚170053956309371 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1373553053184 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚525 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1372769576960 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚22650030 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚172988614816256 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚147440821285888 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚171615061763072 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808cú2å - _wandbruntime‚1399  _runtime‚1399y ¨ö&æ ðM FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚27755023 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚171747796035584 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚50422505 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228864 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 _runtime‚1399.952235356 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚22667482 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚6535317 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚149046733621760 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 % _timestamp‚1.7884797478413506e+09 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚50399206 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚50399206 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚525 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚170186467777185 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚20641123 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _step‚100 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚27755023 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚173121631951360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚171747796035584 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚27731726 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚171747813074944 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚6534795 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚168816442946976 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1491743629312 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚173122432480256 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚50422505 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚20641648 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚14106328 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1491583400448 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚168816459986336 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1374619405312 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1370007790849 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚173122432480256 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1373835915776 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1373835915776 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚147554989992448 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚27755023 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚171747796035584 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚50422505 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228864 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 _runtime‚1399.952235356 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚22667482 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚6535317 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚149046733621760 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 % _timestamp‚1.7884797478413506e+09 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚50399206 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚50399206 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚525 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚170186467777185 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚20641123 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _step‚100 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚27755023 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚173121631951360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚171747796035584 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚27731726 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚171747813074944 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚6534795 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚168816442946976 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1491743629312 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚173122432480256 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚50422505 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚20641648 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚14106328 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1491583400448 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 P@DeviceStatsMonitor.on_train_batch_end/reserved_bÿÊ&ytes.all.current‚ 25794969600 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚168816459986336 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1374619405312 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1370007790849 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚173122432480256 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1373835915776 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1373835915776 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚147554989992448 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚179678724663296 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1421328001743 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚176640429320919 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚176639630799679 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚23522630 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚28797790 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚23522630 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1548287418368 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1426897822208 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚175218302797936 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚179678724663296 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚52343691 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 trainer/global_step‚1299 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚28821061 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚23522628 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚28821061 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 _step‚103 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚178252627356672 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚154696486091264 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚175218319837296 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 187243008 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 _runtime‚1447.575220881 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚179679525178880 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚178252610317312 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884797954646642e+09 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚154696298848256 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚14633571 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚6777411 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚179679525178880 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚178252610317312 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚179679525178880 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚178252610317312 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884797954646642e+09 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚154696298848256 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚14633571 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚6777411 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚179679525178880 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚178252610317312 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚179678724663296 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1421328001743 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚176640429320919 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚176639630799679 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚23522630 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚28797790 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚23522630 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1548287418368 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1426897822208 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚175218302797936 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚179678724663296 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚52343691 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 trainer/global_step‚1299 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚28821061 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚23522628 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚28821061 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 _step‚103 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚178252627356672 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚154696486091264 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚175218319837296 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 187243008 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 _runtime‚1447.575220881 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 IDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚154811585259520 C6DeviceStatœqpsMonitor.on_train_batch_end/active.all.freed‚52359558 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚154811772489216 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 _runtime‚1448.450004332 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚179813342842880 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚179813342842880 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚23540082 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚23540080 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚176771343746045 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1427180684800 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1427180684800 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚52382857 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚28842775 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚21426112 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚6782303 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 trainer/global_step‚1299 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚179812542313984 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚52359558 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚14644331 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1549592352768 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1423172229157 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚154811585259520 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚52359558 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚154811772489216 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 _runtime‚1448.450004332 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚179813342842880 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚179813342842880 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚23540082 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚23540080 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚176771343746045 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1427180684800 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1427180684800 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚52382857 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚28842775 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚21426112 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚6782303 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 trainer/global_step‚1299 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚179812542313984 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚52359558 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚14644331 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1549592352768 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1423172229157 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 FDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚186369635025920 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚184890192950272 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1479459115008 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚24395230 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚29908813 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚186370435541504 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚22196911 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 _step‚107 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚7025861 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚160461428171776 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚183225305289987 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1480242591232 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚54304043 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚160461607026176 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950720 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚184890175910912 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚184890175910912 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚15171571 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚158855226477568 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1606380548608 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚181750829889296 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 _runtime‚1498.987963601 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LBDeviceStats‚¬– Monitor.on_train_batch_start/allocation.small_pool.peak‚28165 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚15171568 trainer/global_step‚1349 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚186370435541504 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚158855201573888 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚24395228 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚29885542 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1479459115008 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚518 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1606226597888 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚22197432 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178854400 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200º¤©Øð'ˆ êO PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚24395230 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚29908813 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚186370435541504 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚22196911 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 _step‚107 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚7025861 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚160461428171776 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚183225305289987 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1480242591232 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚54304043 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚160461607026176 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950720 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚184890175910912 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚184890175910912 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚15171571 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚158855226477568 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1606380548608 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚181750829889296 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 _runtime‚1498.987963601 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚15171568 trainer/global_step‚1349 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚186370435541504 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚158855201573888 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚24395228 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚29885542 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1479459115008 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚518 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1606226597888 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚22197432 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178854400 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚24395228 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1474492440051 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚29908813 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚54280770 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚184890192950272 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚186369635025920 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚184890192950272 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1479459115008 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584kÔ Š>2‰ - _wandbruntime‚1499  _runtime‚1499”jçö&Š ðM PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚29930527 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚185022927222784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1481308943360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚24412682 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1480525453824 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚7030244 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚181881463050976 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚29907230 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚22213091 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚158969345376768 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1607390067200 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚29907230 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1475555185377 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚160576912187904 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚183357816757801 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚15182331 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7030760 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚158969370280448 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚29930527 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1481308943360 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚183357018236353 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚186504253205504 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743936 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151840256 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚185022944262144 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚186504253205504 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚181881480090336 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚54343209 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚54343209 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚22212572 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚54319910 % _timestamp‚1.7884798478463635e+09 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 _runtime‚1499.957261806\÷Ž/$‹ ôM G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚54343209 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚54343209 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚22212572 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚54319910 % _timestamp‚1.7884798478463635e+09 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 _runtime‚1499.957261806 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚29930527 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚185022927222784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1481308943360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚24412682 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1480525453824 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚7030244 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚181881463050976 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚29907230 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚22213091 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚158969345376768 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1607390067200 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚29907230 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1475555185377 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚160576912187904 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚183357816757801 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚15182331 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7030760 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚158969370280448 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚29930527 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1481308943360 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚183357018236353 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚186504253205504 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743936 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151840256 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 K;DeviceStatsMonitor.on_1£kËtrain_batch_end/active_bytes.all.peak‚ 22941488128 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚185022944262144 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚186504253205504 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚181881480090336lH¹!á2Œ - _wandbruntime‚1499  _runtime‚1499 ñ¾ÌZ Ô .loss/FBt4/detection_loss‚2.742126261194547 /loss/FRt2/assignment_loss‚2.800745949512575 /loss/FRt1/detection_loss‚1.5009367666074207 /loss/FRt3/detection_loss‚2.8436430683359504 1loss/SRqqt2/detection_loss‚1.5578257523928627 /loss/SRqqt3/detection_loss‚2.41049531198317 /loss/FBt1/detection_loss‚0.5496850796030568 1loss/FBt1/assignment_loss‚0.17385291296934935 1loss/FBt4/assignment_loss‚0.07101867663228252 /loss/FRt4/detection_loss‚2.2588914993147435 % _timestamp‚1.7884798478494716e+09 0loss/FRt1/assignment_loss‚1.4536294704391843 1loss/SRqqt2/assignment_loss‚1.715349429089463 1loss/FBt2/assignment_loss‚0.13698609574955548 0loss/SRqqt4/detection_loss‚2.170060444729669 %loss/total_loss‚42.63960208908022 trainer/global_step‚1349 1loss/SRqqt3/assignment_loss‚1.908199412966027 .loss/FBt3/detection_loss‚2.489404138765837 .loss/FBt2/detection_loss‚2.606678995219144 _step‚109 0loss/FRt3/assignment_loss‚3.5718327201902866 0loss/FRt4/assignment_loss‚3.5106400087639527 /loss/FRt2/detection_loss‚2.4905047312197164 epoch‚2 _runtime‚1499.959891738 2loss/SRqqt1/assignment_loss‚0.7940690608249054 1loss/FBt3/assignment_loss‚0.11922578719492244 2loss/SRqqt4/assignment_loss‚1.6056522622172322 1loss/SRqqt1/detection_loss‚1.1581482531643714'[é^Ž Ø 1loss/FBt1/assignment_loss‚0.17385291296934935 1loss/FBt4/assignment_loss‚0.07101867663228252 /loss/FRt4/detection_loss‚2.2588914993147435 % _timestamp‚1.7884798478494716e+09 0loss/FRt1/assignment_loss‚1.4536294704391843 1loss/SRqqt2/assignment_loss‚1.715349429089463 1loss/FBt2/assignment_loss‚0.13698609574955548 0loss/SRqqt4/detection_loss‚2.170060444729669 %loss/total_loss‚42.63960208908022 trainer/global_step‚1349 1loss/SRqqt3/assignment_loss‚1.908199412966027 .loss/FBt3/detection_loss‚2.489404138765837 .loss/FBt2/detection_loss‚2.606678995219144 _step‚109 0loss/FRt3/assignment_loss‚3.5718327201902866 0loss/FRt4/assignment_loss‚3.5106400087639527 /loss/FRt2/detection_loss‚2.4905047312197164 epoch‚2 _runtime‚1499.959891738 2loss/SRqqt1/assignment_loss‚0.7940690608249054 1loss/FBt3/assignment_loss‚0.11922578719492244 2loss/SRqqt4/assignment_loss‚1.6056522622172322 1loss/SRqqt1/detection_loss‚1.1581482531643714 .loss/FBt4/detection_loss‚2.742126261194547 /loss/FRt2/assignment_loss‚2.800745949512575 /loss/FRt1/detection_loss‚1.5009367666074207 /loss/FRt3/detection_loss‚2.8436430683359504 1loss/SRqqt2/detection_loss‚1.5578257523928627 /loss/SRqqt3/detection_loss‚2.41049531198317 /loss/FBt1/detection_loss‚0.5496850796030568mÃ( ¬” ‚(:‰ ç’èÔŽú£« gpu.0.gpu‚85.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.966' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.9915 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 “×^ ‚(:Ó ç’èÔ›‹‘­ network.recv‚552018 disk.sdb1.in‚0 disk.sdb2.in‚8.859375 disk.sda2.out‚ 171.87109375 disk.md0.in‚ 62.58984375 disk.dm-0.out‚17735.87890625% disk./.usageGB‚2977.0129013061523 disk.sda1.in‚0 disk.sdb1.out‚0 disk.sda.out‚ 171.87109375 disk.sda1.out‚0 disk.sdb2.out‚ 171.87109375 disk.sda2.in‚ 53.73046875 disk.rbd2.out‚ 0.279296875' proc.memory.availableMB‚ 4518.703125 disk.sdb.in‚8.859375 disk.sdb.out‚ 171.87109375 network.sent‚ 2.626645e+06 disk.md0.out‚ 165.609375 disk.rbd0.out‚ 0.279296875# proc.memory.rssMB‚ 3172.13671875 proc.cpu.threads‚17 disk.nvme0n1.in‚ 220.71875" disk.nvme0n1.out‚ 10719.8203125 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 165.609375 disk.rbd0.in‚0 disk.rbd2.in‚0$ memory_percent‚72.42002487182617* proc.memory.percent‚19.361186027526855 disk.sda.in‚ 53.73046875" disk.nvme1n1.out‚ 7016.05859375 disk.md0p1.in‚ 62.58984375 cpu‚25.65203016003428) disk./.usagePercent‚83.23852669721651 disk.dm-0.in‚ 253.17578125šè~@”‘ ‚(:‰ ö’èÔ£ÉDz gpu.0.gpu‚48.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚146.997' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚36.74925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ΙAÁK’ ‚(:À ö’èÔæ辶 disk.sda2.in‚ 53.73046875 disk.sda2.out‚ 173.84375 disk.md0p1.in‚ 62.58984375 disk.rbd0.in‚0 network.sent‚ 2.699378e+06 disk.sdb2.out‚ 173.84375 disk.sda1.in‚0$ disk./.usageGB‚2977.012233734131 disk.sdb.in‚8.859375 disk.md0p1.out‚ 167.515625 disk.rbd0.out‚ 0.279296875 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0 disk.sda.in‚ 53.73046875 proc.cpu.threads‚17" disk.nvme1n1.out‚ 7151.60546875# memory_percent‚72.4191665649414& proc.memory.availableMB‚ 4518.84375 disk.sdb.out‚ 173.84375 disk.sdb2.in‚8.859375 disk.rbd2.in‚0 disk.sdb1.in‚0 network.recv‚556639( disk./.usagePercent‚83.2385080316234 disk.nvme0n1.out‚ 10719.875 disk.md0.in‚ 62.58984375 disk.dm-0.out‚17871.48046875 disk.rbd2.out‚ 0.279296875 disk.sda1.out‚0# proc.memory.rssMB‚ 3172.13671875 disk.md0.out‚ 167.515625 cpu‚25.650401806417705 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125* proc.memory.percent‚19.361186027526855 disk.sda.out‚ 173.84375h$*s“ ‚(:’ …“èÔÅ•…« gpu.0.gpu‚52.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚222.134' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚55.53349999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ó‰Rn” ‚(:ã …“èÔ…Û¤¬ disk.sda1.in‚0# proc.memory.rssMB‚ 3172.13671875 disk.md0p1.in‚ 62.58984375 disk.dm-0.in‚ 253.17578125 disk.sdb2.in‚8.859375! disk.sdb2.out‚175.46630859375$ memory_percent‚72.42236137390137 network.sent‚ 2.706297e+06! disk.sda2.out‚175.46630859375 disk.md0.out‚ 169.06640625 disk.rbd2.in‚0# disk.nvme0n1.out‚10720.16015625 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚8.859375* proc.memory.percent‚19.361186027526855 disk.sda2.in‚ 53.73046875 disk.rbd0.out‚ 0.279296875 disk.sda.out‚175.46630859375 network.recv‚561818$ disk./.usageGB‚2977.012237548828 disk.md0p1.out‚ 169.06640625( proc.memory.availableMB‚ 4518.3203125 disk.rbd0.in‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.out‚ 7440.296875 disk.sdb.out‚175.46630859375 cpu‚25.648987960795658 proc.cpu.threads‚17) disk./.usagePercent‚83.23850813828393 disk.md0.in‚ 62.58984375 disk.rbd2.out‚ 0.279296875 disk.sda.in‚ 53.73046875 disk.dm-0.out‚18160.45703125 disk.sdb1.in‚0 disk.sdb1.out‚0|°–“• ‚(:ˆ ”“èÔ–§Æ© gpu.0.gpu‚57.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚228.924' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.231 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0é$²¹n– ‚(:ã ”“èÔäÁ÷ª network.sent‚ 2.711281e+06 disk.nvme1n1.out‚ 7642.078125 disk.sdb.in‚8.859375 disk.sda1.in‚0# memory_percent‚72.4200963973999# proc.memory.rssMB‚ 3172.13671875* proc.memory.percent‚19.361186027526855 network.recv‚565428 disk.md0.out‚ 170.55078125$ disk./.usageGB‚2977.012237548828! disk.sdb2.out‚177.02001953125 disk.rbd0.in‚0 disk.sda.out‚177.02001953125 proc.cpu.threads‚17 disk.sda1.out‚0 disk.sda2.in‚ 53.73046875 disk.md0p1.in‚ 62.58984375 disk.md0p1.out‚ 170.55078125) proc.memory.availableMB‚ 4518.69140625 disk.rbd2.in‚0 disk.rbd2.out‚ 0.279296875 disk.nvme0n1.in‚ 220.71875# disk.nvme0n1.out‚10720.22265625) disk./.usagePercent‚83.23850813828393 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚177.02001953125! disk.sda2.out‚177.02001953125 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0 disk.sdb2.in‚8.859375 disk.md0.in‚ 62.58984375 disk.rbd0.out‚ 0.279296875 disk.dm-0.out‚18362.30078125 disk.sdb1.in‚0 disk.sda.in‚ 53.73046875 cpu‚25.648568982190593yIT×2— - _wandbruntime‚1554  _runtime‚1554OAïÉØ ½ $ lr-AdamW/pg2‚0.00113420146034454 trainer/global_step‚1399 % _timestamp‚1.7884799022853594e+09 _runtime‚1554.395686458 _step‚110 $ lr-AdamW/pg1‚0.00113420146034454ÕZÇ™ Á $ lr-AdamW/pg1‚0.00113420146034454 $ lr-AdamW/pg2‚0.00113420146034454 trainer/global_step‚1399 % _timestamp‚1.7884799022853594e+09 _runtime‚1554.395686458 _step‚110nû½©2š - _wandbruntime‚1554  _runtime‚1554¾¹½ì'› æO TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚30996565 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚164562391717888 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 trainer/global_step‚1399 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 % _timestamp‚1.7884799022868314e+09 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚193061345904128 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚191527758543872 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚22984802 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚166226331709440 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚22984260 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚188283339941296 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚193061345904128 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚25267828 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚30973294 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚193060545388544 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1664098136576 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1532803884032 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚15709568 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚7275231 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158145024 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚188283322901936 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1533587360256 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚539 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚164562416621568 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1663939991552 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚30973294 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1528438360239 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚191527741504512 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400Atݸð'œ êO F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1533587360256 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚539 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚164562416621568 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1663939991552 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚30973294 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1528438360239 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚191527741504512 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚30996565 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚164562391717888 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 trainer/global_step‚1399 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 % _timestamp‚1.7884799022868314e+09 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚193061345904128 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚191527758543872 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚22984802 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚166226331709440 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚22984260 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚188283339941296 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚193061345904128 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚25267828 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚30973294 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚193060545388544 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1664098136576 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1532803884032 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚15709568 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚7275231 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158145024 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚188283322901936oÐw¡2 - _wandbruntime‚1555  _runtime‚1555eXssæž ðM E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1534653712384 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚191660509855744 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚23000008 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚193195163568128 S?DevicB‹€îeStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚193194363039232 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚189942692726661 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚56303561 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚56280262 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚25285282 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚56303561 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _runtime‚1555.379482143 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚31018279 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1665095259648 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚25285280 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚23000520 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚164676535520768 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚191660492816384 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1533870222848 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7280189 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚15720328 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1665249197056 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚166341809621504 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1529501105773 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1528719623685 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚25285280 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚164676560424448 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚31018279 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚30994982 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153937408 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680Ϥº*ú&Ÿ ôM F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153937408 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1534653712384 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚191660509855744 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚23000008 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚193195163568128 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚193194363039232 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚189942692726661 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚56303561 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚56280262 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚25285282 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚56303561 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _runtime‚1555.379482143 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚31018279 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1665095259648 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚25285280 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚23000520 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚164676535520768 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚191660492816384 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1533870222848 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7280189 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚15720328 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1665249197056 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚166341809621504 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1529501105773 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1528719623685 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚25285280 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚164676560424448 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚31018279 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚30994982p”áï­2  - _wandbruntime‚1555  _runtime‚1555SŸ° V¡ Ð .loss/FBt3/detection_loss‚2.888070471584797 epoch‚2 trainer/global_step‚1399 0loss/FRt2/assignment_loss‚2.8380612990957625 /loss/FRt3/assignment_loss‚3.618910180727641 1loss/FBt1/assignment_loss‚0.16055113056469936 1loss/SRqqt2/detection_loss‚1.4464135814238996 &loss/total_loss‚43.495778560641995 _runtime‚1555.381960555 2loss/SRqqt4/assignment_loss‚1.8270407547161245 0loss/SRqqt3/detection_loss‚2.279121041736182 % _timestamp‚1.7884799032715611e+09 0loss/FBt2/assignment_loss‚0.1572584628512459 /loss/FRt3/detection_loss‚2.7925296982129413 0loss/SRqqt4/detection_loss‚2.371191285681306 .loss/FBt1/detection_loss‚0.615747531259198 .loss/FBt2/detection_loss‚2.640600062906742 _step‚113 /loss/FRt4/assignment_loss‚3.510066411828482 2loss/SRqqt2/assignment_loss‚1.5954556654152625 0loss/SRqqt3/assignment_loss‚2.16921719338964 1loss/SRqqt1/detection_loss‚0.9470881469743816 1loss/FBt4/assignment_loss‚0.33745185057432536 .loss/FRt1/detection_loss‚1.561506697175543 .loss/FRt2/detection_loss‚2.322203313416623 .loss/FRt4/detection_loss‚2.083557267993769 0loss/FRt1/assignment_loss‚1.4939261701669586 2loss/SRqqt1/assignment_loss‚0.9925953478384343 1loss/FBt3/assignment_loss‚0.11506881543198233 .loss/FBt4/detection_loss‚2.732146179676056ubF¹Z¢ Ô .loss/FBt1/detection_loss‚0.615747531259198 .loss/FBt2/detection_loss‚2.640600062906742 _step‚113 /loss/FRt4/assignment_loss‚3.510066411828482 2loss/SRqqt2/assignment_loss‚1.5954556654152625 0loss/SRqqt3/assignment_loss‚2.16921719338964 1loss/SRqqt1/detection_loss‚0.9470881469743816 1loss/FBt4/assignment_loss‚0.33745185057432536 .loss/FRt1/detection_loss‚1.561506697175543 .loss/FRt2/detection_loss‚2.322203313416623 .loss/FRt4/detection_loss‚2.083557267993769 0loss/FRt1/assignment_loss‚1.4939261701669586 2loss/SRqqt1/assignment_loss‚0.9925953478384343 1loss/FBt3/assignment_loss‚0.11506881543198233 .loss/FBt4/detection_loss‚2.732146179676056 .loss/FBt3/detection_loss‚2.888070471584797 epoch‚2 trainer/global_step‚1399 0loss/FRt2/assignment_loss‚2.8380612990957625 /loss/FRt3/assignment_loss‚3.618910180727641 1loss/FBt1/assignment_loss‚0.16055113056469936 1loss/SRqqt2/detection_loss‚1.4464135814238996 &loss/total_loss‚43.495778560641995 _runtime‚1555.381960555 2loss/SRqqt4/assignment_loss‚1.8270407547161245 0loss/SRqqt3/detection_loss‚2.279121041736182 % _timestamp‚1.7884799032715611e+09 0loss/FBt2/assignment_loss‚0.1572584628512459 /loss/FRt3/detection_loss‚2.7925296982129413 0loss/SRqqt4/detection_loss‚2.371191285681306qg5¬æ“£ ‚(:ˆ £“èÔ°Ù‡¬ gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0j-Yso¤ ‚(:ä £“èԦǤ¬ disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.71875 disk.sdb1.out‚0 disk.sda.in‚ 53.73046875 disk.sda1.in‚0 disk.sdb.out‚178.53466796875( proc.memory.availableMB‚ 4518.3515625 disk.sdb.in‚8.859375 network.sent‚ 2.718235e+06% disk./.usageGB‚2976.4866333007812 disk.sda2.in‚ 53.73046875 disk.md0.in‚ 62.58984375 disk.md0p1.in‚ 62.58984375 disk.md0p1.out‚ 172.01171875 disk.rbd0.out‚ 0.279296875 disk.sda.out‚178.53466796875 disk.nvme1n1.in‚ 32.45703125 disk.nvme1n1.out‚ 7875.140625 disk.sdb2.in‚8.859375! disk.sdb2.out‚178.53466796875 network.recv‚569885) disk./.usagePercent‚83.22381202352607 disk.md0.out‚ 172.01171875 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125* proc.memory.percent‚19.361186027526855 disk.dm-0.out‚18595.73828125 disk.sdb1.in‚0$ memory_percent‚72.42217063903809# proc.memory.rssMB‚ 3172.13671875 cpu‚25.648380574941413 proc.cpu.threads‚17! disk.sda2.out‚178.53466796875 disk.rbd2.out‚ 0.279296875 disk.sda1.out‚0# disk.nvme0n1.out‚10720.59765625ßXÓ“¥ ‚(:ˆ ²“èÔäÝÈ« gpu.0.gpu‚69.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚124.044' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚31.011 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¡þl¦ ‚(:á ²“èÔ†áû¬! disk.sda2.out‚180.53369140625 disk.md0p1.out‚ 173.9453125 disk.rbd2.in‚0 disk.sda.out‚180.53369140625# proc.memory.rssMB‚ 3172.13671875 network.recv‚574046$ disk./.usageGB‚2976.436695098877 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0" disk.nvme1n1.out‚ 7967.77734375 disk.sdb2.in‚8.859375) proc.memory.availableMB‚ 4406.19921875 disk.md0.out‚ 173.9453125# disk.nvme0n1.out‚10720.64453125 disk.sdb.out‚180.53369140625 disk.md0p1.in‚ 62.58984375 disk.rbd0.out‚ 0.279296875 disk.sda1.in‚0! disk.sdb2.out‚180.53369140625 disk.sda2.in‚ 53.73046875 disk.sda1.out‚0 disk.rbd0.in‚0 disk.rbd2.out‚ 0.279296875 cpu‚25.64589064807182 proc.cpu.threads‚17 network.sent‚ 2.805277e+06 disk.dm-0.out‚ 18688.421875 disk.sda.in‚ 53.73046875 disk.nvme0n1.in‚ 220.71875 disk.sdb.in‚8.859375$ memory_percent‚73.10669422149658) disk./.usagePercent‚83.22241573050006 disk.md0.in‚ 62.58984375 disk.sdb1.in‚0 disk.nvme1n1.in‚ 32.45703125* proc.memory.percent‚19.361186027526855 âÉ•§ ‚(:Š Á“èÔ¢Ûýª gpu.0.gpu‚85.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚239.159' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚59.78975 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ôÜO"_¨ ‚(:Ô Á“èÔ÷¸ñ« disk.sdb1.in‚0 disk.md0.out‚176# disk.nvme0n1.out‚10720.80078125 disk.sdb.in‚8.859375 disk.sda2.in‚ 53.73046875% disk./.usageGB‚2976.5118980407715$ memory_percent‚73.10593128204346# proc.memory.rssMB‚ 3172.13671875 disk.rbd2.out‚ 0.279296875 disk.rbd0.out‚ 0.279296875 cpu‚25.643657937661708! disk.sdb2.out‚182.65869140625! disk.sda2.out‚182.65869140625 disk.md0p1.out‚176 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.sda.in‚ 53.73046875 disk.md0p1.in‚ 62.58984375* proc.memory.percent‚19.361186027526855 network.recv‚578871) disk./.usagePercent‚83.22451843623031 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 18837.8046875 disk.rbd2.in‚0 disk.sda.out‚182.65869140625 disk.nvme0n1.in‚ 220.71875 proc.cpu.threads‚17 disk.sda1.in‚0 disk.sda1.out‚0" disk.nvme1n1.out‚ 8117.00390625 disk.sdb.out‚182.65869140625 disk.sdb2.in‚8.859375 disk.md0.in‚ 62.58984375 network.sent‚ 2.811955e+06 disk.nvme1n1.in‚ 32.45703125) proc.memory.availableMB‚ 4406.32421875¢É•© ‚(:Š ГèÔž÷³ª gpu.0.gpu‚71.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚125.603' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚31.40075 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ù³|lª ‚(:á ГèԾɫ disk.nvme1n1.in‚ 32.45703125 disk.rbd0.out‚ 0.279296875 proc.cpu.threads‚17 network.recv‚582523 disk.dm-0.in‚ 253.17578125 disk.sda1.in‚0 disk.sda2.in‚ 53.73046875 disk.md0p1.out‚ 177.76171875$ memory_percent‚73.76594543457031% proc.memory.availableMB‚ 4298.1875# proc.memory.rssMB‚ 3172.13671875 network.sent‚ 2.817067e+06 disk.sda1.out‚0 disk.md0.in‚ 62.58984375* proc.memory.percent‚19.361186027526855 disk.sdb1.in‚0 disk.sda.in‚ 53.73046875 disk.sda.out‚184.47900390625 disk.sdb.in‚8.859375 disk.sdb2.in‚8.859375! disk.sdb2.out‚184.47900390625! disk.sda2.out‚184.47900390625 disk.rbd2.in‚0 disk.rbd2.out‚ 0.279296875 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.rbd0.in‚0 cpu‚25.641898585445432) disk./.usagePercent‚83.22546035538949$ disk./.usageGB‚2976.545585632324 disk.dm-0.out‚18984.44140625# disk.nvme0n1.out‚10720.93359375 disk.md0.out‚ 177.76171875! disk.nvme1n1.out‚ 8263.5078125 disk.sdb.out‚184.47900390625 disk.md0p1.in‚ 62.58984375È ÚP2« - _wandbruntime‚1610  _runtime‚1610è€Ï8Ǭ Á & lr-AdamW/pg2‚0.0011263144125879749 trainer/global_step‚1449 % _timestamp‚1.7884799586174803e+09 _runtime‚1610.732089821 _step‚114 & lr-AdamW/pg1‚0.0011263144125879749êúàË­ Å _step‚114 & lr-AdamW/pg1‚0.0011263144125879749 & lr-AdamW/pg2‚0.0011263144125879749 trainer/global_step‚1449 % _timestamp‚1.7884799586174803e+09 _runtime‚1610.732089821rT”q2® - _wandbruntime‚1610  _runtime‚1610øÞf´ª¯ äO VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚199752256266752 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚23771277 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 $ _timestamp‚1.788479958623412e+09 _step‚115 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚199751455751168 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚198165324137472 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1580821316667 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1586148653056 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚26140430 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚26140428 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚26140430 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1586148653056 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚23771785 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚196396654270603 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚170269606765568 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚32061046 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚505 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚198165324137472 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1581602798547 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚170269581861888 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚199752256266752 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚194815832953936 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1586932129280 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚198165307098112 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178854400 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1721991797760 trainer/global_step‚1449 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚196397452791843 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚7523709 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚199751455751168 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚32084317 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚16247568 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚7524214 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950720 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚198165307098112 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚16247571 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1586932129280 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚32084317 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚171991419708928 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1721837847040 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚58201474 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚26140428 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚171991598563328 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚508 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚199751455751168 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚32084317 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚16247568 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚7524214 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950720 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚198165307098112 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚16247571 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1586932129280 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚32084317 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚171991419708928 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1721837847040 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚58201474 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚26140428 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚171991598563328 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚508 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚194946483154976 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1587214991872 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1587998481408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚194946500194336 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1582665544081 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1587214991872 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚170383725664768 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚26157880 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚198298075449344 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7529195 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚199885273401856 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚32106031 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 147645952 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚23787022 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚199886073930752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1723153900544 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚58263913 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚26157882 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚32082734 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚16258328 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚58263913 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚58240614 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1581884061993 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚26157880 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _runtime‚1611.816224043 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚199886073930752 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚198298058409984 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚196528367216969 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1587998481408 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚170383750568448 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _step‚116 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚26157882 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚504 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚501 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚23787526 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚32106031 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚194946483154976 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1587214991872 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1587998481408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚194946500194336 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1582665544081 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1587214991872 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚170383725664768 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚26157880 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚198298075449344 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7529195 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚199885273401856 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚32106031 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 147645952 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚23787022 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚199886073930752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1723153900544 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚58263913 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚26157882 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚32082734 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚16258328 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚58263913 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚58240614 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚Ýj¿Qo 1784 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1581884061993 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚26157880 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _runtime‚1611.816224043 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚199886073930752 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚198298058409984 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚196528367216969 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1587998481408 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚170383750568448 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _step‚116 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚26157882t€vˆa2´ - _wandbruntime‚1611  _runtime‚1611øÐqƒ[µ Õ &loss/total_loss‚42.312657719713854 $ _timestamp‚1.788479959707332e+09 1loss/SRqqt3/assignment_loss‚2.142566309635898 2loss/FBt3/assignment_loss‚0.029487269323518767 /loss/FRt4/detection_loss‚2.1871477080200314 /loss/FBt3/detection_loss‚2.6925405242613385 /loss/FRt3/assignment_loss‚2.994589381071986 1loss/FBt1/assignment_loss‚0.12334011830451583 0loss/FBt2/assignment_loss‚0.8286468990761653 1loss/FBt4/assignment_loss‚0.08516067565035294 .loss/FRt2/detection_loss‚2.310359157364944 /loss/FRt3/detection_loss‚3.1611747997147694 epoch‚2 0loss/SRqqt3/detection_loss‚2.014171431581658 _step‚117 0loss/FRt2/assignment_loss‚2.4498949174223275 2loss/SRqqt1/assignment_loss‚1.0337442474232779 0loss/SRqqt4/detection_loss‚2.546498411580136 trainer/global_step‚1449 2loss/SRqqt2/assignment_loss‚1.4481243528912204 /loss/FBt2/detection_loss‚3.2409142072384176 _runtime‚1611.817494619 0loss/FRt4/assignment_loss‚3.1819162459477135 1loss/SRqqt4/assignment_loss‚1.606745879901083 .loss/FRt1/detection_loss‚1.647083199582994 1loss/SRqqt1/detection_loss‚0.9937580722901557 1loss/SRqqt2/detection_loss‚1.5261590529177615 0loss/FRt1/assignment_loss‚1.1679673141241074 /loss/FBt1/detection_loss‚0.6088204398540961 .loss/FBt4/detection_loss‚2.291847104535383•yñ€_¶ Ù 0loss/FRt2/assignment_loss‚2.4498949174223275 2loss/SRqqt1/assignment_loss‚1.0337442474232779 0loss/SRqqt4/detection_loss‚2.546498411580136 trainer/global_step‚1449 2loss/SRqqt2/assignment_loss‚1.4481243528912204 /loss/FBt2/detection_loss‚3.2409142072384176 _runtime‚1611.817494619 0loss/FRt4/assignment_loss‚3.1819162459477135 1loss/SRqqt4/assignment_loss‚1.606745879901083 .loss/FRt1/detection_loss‚1.647083199582994 1loss/SRqqt1/detection_loss‚0.9937580722901557 1loss/SRqqt2/detection_loss‚1.5261590529177615 0loss/FRt1/assignment_loss‚1.1679673141241074 /loss/FBt1/detection_loss‚0.6088204398540961 .loss/FBt4/detection_loss‚2.291847104535383 &loss/total_loss‚42.312657719713854 $ _timestamp‚1.788479959707332e+09 1loss/SRqqt3/assignment_loss‚2.142566309635898 2loss/FBt3/assignment_loss‚0.029487269323518767 /loss/FRt4/detection_loss‚2.1871477080200314 /loss/FBt3/detection_loss‚2.6925405242613385 /loss/FRt3/assignment_loss‚2.994589381071986 1loss/FBt1/assignment_loss‚0.12334011830451583 0loss/FBt2/assignment_loss‚0.8286468990761653 1loss/FBt4/assignment_loss‚0.08516067565035294 .loss/FRt2/detection_loss‚2.310359157364944 /loss/FRt3/detection_loss‚3.1611747997147694 epoch‚2 0loss/SRqqt3/detection_loss‚2.014171431581658 _step‚117u£ò¯“· ‚(:ˆ ß“èÔû£Ó« gpu.0.gpu‚8.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¥Zþ:o¸ ‚(:ä ß“èÔ£ÂÏ­ disk.md0.in‚ 62.58984375 disk.md0.out‚ 179.16796875 disk.dm-0.in‚ 253.17578125) disk./.usagePercent‚83.22807769818722 cpu‚25.640547609964695 disk.sdb1.in‚0 disk.sda1.out‚0 disk.sdb.out‚185.93701171875 disk.rbd0.out‚ 0.279296875 disk.md0p1.in‚ 62.58984375 disk.md0p1.out‚ 179.16796875" disk.nvme1n1.out‚ 8494.59765625 network.recv‚587112% disk./.usageGB‚2976.6391944885254 disk.sda.in‚ 53.73046875 disk.sda1.in‚0 disk.sdb.in‚8.859375 network.sent‚ 2.83426e+06! disk.sdb2.out‚185.93701171875 disk.rbd0.in‚0 disk.rbd2.in‚0$ memory_percent‚75.28738975524902# disk.nvme0n1.out‚10721.09765625 disk.nvme1n1.in‚ 32.45703125 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.sda2.in‚ 53.73046875 proc.cpu.threads‚17 disk.dm-0.out‚ 19215.6953125 disk.rbd2.out‚ 0.279296875( proc.memory.availableMB‚ 4048.9140625# proc.memory.rssMB‚ 3172.13671875* proc.memory.percent‚19.361186027526855 disk.sda.out‚185.93701171875 disk.sdb2.in‚8.859375! disk.sda2.out‚185.93701171875>ÚW铹 ‚(:ˆ î“èÔÿÕ¦« gpu.0.gpu‚71.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚203.75' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚50.9375 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0~¹^iº ‚(:Þ î“èÔÙÜ‘­% disk./.usageGB‚2976.7641944885254 disk.md0.in‚ 62.58984375 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 19475.234375 disk.sdb2.out‚187.4619140625) disk./.usagePercent‚83.23157275050377 disk.md0p1.in‚ 62.58984375 disk.sdb1.out‚0 disk.sda1.in‚0# disk.nvme0n1.out‚10721.14453125 disk.nvme1n1.in‚ 32.45703125( proc.memory.availableMB‚ 4245.9921875 disk.sdb.in‚8.859375 disk.rbd0.in‚0 disk.rbd0.out‚ 0.279296875 disk.rbd2.in‚0 disk.rbd2.out‚ 0.279296875 disk.sda1.out‚0* proc.memory.percent‚19.361186027526855 disk.md0p1.out‚ 180.6328125 disk.sdb.out‚187.4619140625 disk.sdb2.in‚8.859375# proc.memory.rssMB‚ 3172.13671875 network.recv‚591847 disk.sda.in‚ 53.73046875 disk.sda.out‚187.4619140625 network.sent‚ 2.908966e+06 disk.md0.out‚ 180.6328125 disk.sdb1.in‚0 disk.nvme0n1.in‚ 220.71875" disk.nvme1n1.out‚ 8754.08984375 disk.sda2.in‚ 53.73046875 disk.sda2.out‚187.4619140625$ memory_percent‚74.08452033996582 cpu‚25.639899737480203 proc.cpu.threads‚17÷/f“» ‚(:ˆ ý“èÔå’ñ« gpu.0.gpu‚43.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚121.876' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.469 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ˆk õ`¼ ‚(:Õ ý“èÔÜ ‰­) disk./.usagePercent‚83.23856253515531% disk./.usageGB‚2977.0141830444336 disk.nvme0n1.in‚ 220.71875 disk.sdb.in‚8.859375 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 19677.34375 disk.sdb1.in‚0 disk.sda1.in‚0 disk.md0.in‚ 62.58984375 disk.md0.out‚182.9375 disk.rbd2.in‚0$ memory_percent‚74.91946220397949# proc.memory.rssMB‚ 3172.13671875 disk.sdb.out‚189.8271484375 disk.sdb2.in‚8.859375 disk.sda2.in‚ 53.73046875 disk.md0p1.in‚ 62.58984375 disk.md0p1.out‚182.9375 disk.sda.out‚189.8271484375 disk.sda.in‚ 53.73046875 network.sent‚ 2.915576e+06 network.recv‚596533" disk.nvme0n1.out‚ 10721.2890625! disk.nvme1n1.out‚ 8956.0546875 disk.rbd0.in‚0 disk.rbd0.out‚ 0.279296875 disk.sda1.out‚0 disk.sda2.out‚189.8271484375 disk.rbd2.out‚ 0.279296875* proc.memory.percent‚19.361186027526855 proc.cpu.threads‚17 disk.sdb2.out‚189.8271484375( proc.memory.availableMB‚ 4109.1953125 cpu‚25.639398254745565 disk.nvme1n1.in‚ 32.45703125 disk.sdb1.out‚0… ö·“½ ‚(:ˆ Œ”èÔ¬ªÿª gpu.0.gpu‚48.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚227.312' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.828 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0掉†^¾ ‚(:Ó Œ”èÔùˆ×«) disk./.usagePercent‚83.23856242849477% disk./.usageGB‚2977.0141792297363 disk.dm-0.in‚ 253.17578125 disk.rbd2.out‚ 0.279296875* proc.memory.percent‚19.361186027526855 disk.dm-0.out‚19936.89453125! disk.sda2.out‚193.64501953125 disk.rbd0.out‚ 0.279296875 disk.sdb.out‚193.64501953125 network.sent‚ 2.920795e+06 network.recv‚600316 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 186.6796875 disk.sdb1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚193.64501953125 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 disk.md0.out‚ 186.6796875 disk.sdb1.out‚0 disk.sda.out‚193.64501953125 disk.sda1.in‚0" disk.nvme1n1.out‚ 9215.55078125 disk.sdb.in‚ 8.96484375 disk.sda.in‚ 55.390625 disk.sda1.out‚0 disk.sdb2.in‚ 8.96484375 memory_percent‚ 75.87890625# proc.memory.rssMB‚ 3172.13671875 cpu‚25.638801085831343 proc.cpu.threads‚17 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.nvme0n1.out‚ 10721.34375 proc.memory.availableMB‚3952%)0-2¿ - _wandbruntime‚1668  _runtime‚1668}§ïŠÄÀ ¾ % lr-AdamW/pg1‚0.001117986353773274 % lr-AdamW/pg2‚0.001117986353773274 trainer/global_step‚1499 $ _timestamp‚1.788480016199626e+09 _runtime‚1668.310789159 _step‚118D¶1ÈÁ  $ _timestamp‚1.788480016199626e+09 _runtime‚1668.310789159 _step‚118 % lr-AdamW/pg1‚0.001117986353773274 % lr-AdamW/pg2‚0.001117986353773274 trainer/global_step‚1499vVÄ¡.2 - _wandbruntime‚1668  _runtime‚1668ó~¸Xë'à åO OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚204802889731072 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚206442366113792 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚27013030 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1634767236855 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚177756510584320 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚27013028 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚33172069 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1779903014912 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚201348343005936 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1633985754975 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚16785568 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚177756699924480 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚24558429 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚60185099 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚204802872691712 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚175976772005888 trainer/global_step‚1499 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 164436480 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 $ _timestamp‚1.788480016200768e+09 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚16785571 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚202982328760911 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚206442366113792 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚7772861 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚204802872691712 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1639493422080 _step‚119 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚206443166629376 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚16785568 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚177756699924480 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚24558429 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚60185099 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚204802872691712 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚175976772005888 trainer/global_step‚1499 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 164436480 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 $ _timestamp‚1.788480016200768e+09 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚16785571 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚202982328760911 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚206442366113792 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚7772861 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚204802872691712 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1639493422080 _step‚119 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚206443166629376 I8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚170 Á]»%39360 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1635829982389 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚24574625 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚176090915808768 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚176090940712448 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚204935641042944 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚16796331 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚206576984293376 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚27030482 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚33193783 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚60200966 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚24574103 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚16796328 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚201479010246336 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚33193783 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚177871996575744 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚33170486 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚27030482 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7778294 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 % _timestamp‚1.7884800172774148e+09 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1640559760896 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚60224265 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚177871824026112 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚203114041707277 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896ó­Ó_ú&Ç ôM S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚203114041707277 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚27030480 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚7777775 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1635829982389 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚24574625 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚176090915808768 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚176090940712448 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚204935641042944 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚16796331 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚206576984293376 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚27030482 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚33193783 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚60200966 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚24574103 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚16796328 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚201479010246336 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚33193783 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚177871996575744 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚33170486 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚27030482 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚7778294 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 % _timestamp‚1.7884800172774148e+09 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1640559760896 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚60224265 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚177871824026112 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600xÿúçX2È - _wandbruntime‚1669  _runtime‚1669á#2ZÉ Ô .loss/FBt3/detection_loss‚2.444394958646674 % _timestamp‚1.7884800172810276e+09 0loss/FRt4/assignment_loss‚3.6158678969558404 2loss/SRqqt3/assignment_loss‚1.9802141545994862 1loss/FBt2/assignment_loss‚0.10972114460003611 .loss/FBt2/detection_loss‚2.333027089896955 %loss/total_loss‚42.35342160993281 1loss/FBt3/assignment_loss‚0.33945625644388666 /loss/FRt3/detection_loss‚2.8544443899126195 1loss/SRqqt2/detection_loss‚1.4297330185579948 _runtime‚1669.391247539 _step‚121 1loss/FBt4/assignment_loss‚0.20365771907993555 /loss/FRt2/detection_loss‚2.2070466124697736 1loss/SRqqt1/detection_loss‚1.0981332498469523 /loss/FRt1/assignment_loss‚1.312060784548521 1loss/SRqqt1/assignment_loss‚0.853893240547872 1loss/SRqqt2/assignment_loss‚1.697168202055857 2loss/SRqqt4/assignment_loss‚1.8346378748952332 1loss/FBt1/assignment_loss‚0.12041908713020487 /loss/FBt4/detection_loss‚2.5535104356028815 /loss/FRt2/assignment_loss‚2.838335899302834 .loss/FRt1/detection_loss‚1.827887118794024 .loss/FRt4/detection_loss‚2.323776338129466 1loss/SRqqt3/detection_loss‚2.3098270152066207 epoch‚2 /loss/FRt3/assignment_loss‚3.061160797503457 1loss/SRqqt4/detection_loss‚2.4552031785754833 trainer/global_step‚1499 /loss/FBt1/detection_loss‚0.5498451466301981E¯Ê^Ê Ø 1loss/FBt4/assignment_loss‚0.20365771907993555 /loss/FRt2/detection_loss‚2.2070466124697736 1loss/SRqqt1/detection_loss‚1.0981332498469523 /loss/FRt1/assignment_loss‚1.312060784548521 1loss/SRqqt1/assignment_loss‚0.853893240547872 1loss/SRqqt2/assignment_loss‚1.697168202055857 2loss/SRqqt4/assignment_loss‚1.8346378748952332 1loss/FBt1/assignment_loss‚0.12041908713020487 /loss/FBt4/detection_loss‚2.5535104356028815 /loss/FRt2/assignment_loss‚2.838335899302834 .loss/FRt1/detection_loss‚1.827887118794024 .loss/FRt4/detection_loss‚2.323776338129466 1loss/SRqqt3/detection_loss‚2.3098270152066207 epoch‚2 /loss/FRt3/assignment_loss‚3.061160797503457 1loss/SRqqt4/detection_loss‚2.4552031785754833 trainer/global_step‚1499 /loss/FBt1/detection_loss‚0.5498451466301981 .loss/FBt3/detection_loss‚2.444394958646674 % _timestamp‚1.7884800172810276e+09 0loss/FRt4/assignment_loss‚3.6158678969558404 2loss/SRqqt3/assignment_loss‚1.9802141545994862 1loss/FBt2/assignment_loss‚0.10972114460003611 .loss/FBt2/detection_loss‚2.333027089896955 %loss/total_loss‚42.35342160993281 1loss/FBt3/assignment_loss‚0.33945625644388666 /loss/FRt3/detection_loss‚2.8544443899126195 1loss/SRqqt2/detection_loss‚1.4297330185579948 _runtime‚1669.391247539 _step‚121yÒY§î“Ë ‚(:ˆ ›”èÔ¸ªïª gpu.0.gpu‚68.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚116.916' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.229 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0QP²fÌ ‚(:Û ›”èÔ šµ® disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.nvme1n1.out‚ 9496.1875 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.md0p1.out‚ 188.19921875 disk.sdb1.out‚0 disk.md0p1.in‚ 64.35546875 disk.sda.out‚195.2197265625) disk./.usagePercent‚83.23855890869723 disk.sdb.out‚195.2197265625 disk.sda2.out‚195.2197265625 disk.rbd2.out‚ 0.279296875$ memory_percent‚75.87735652923584* proc.memory.percent‚19.361186027526855 cpu‚25.638085741386934 network.recv‚604128% disk./.usageGB‚2977.0140533447266 disk.rbd0.out‚ 0.279296875 disk.dm-0.out‚ 20217.859375 proc.cpu.threads‚17 disk.sda2.in‚ 55.390625 disk.md0.out‚ 188.19921875 disk.dm-0.in‚ 253.17578125 disk.rbd2.in‚0 disk.sda1.in‚0 disk.sdb2.out‚195.2197265625 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sda.in‚ 55.390625 disk.md0.in‚ 64.35546875) proc.memory.availableMB‚ 3952.25390625# proc.memory.rssMB‚ 3172.13671875 network.sent‚ 2.936928e+06 disk.nvme0n1.in‚ 220.71875! disk.nvme0n1.out‚ 10721.671875ügma•Í ‚(:Š ª”èԵƌ« gpu.0.gpu‚72.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚208.101' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.02525 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÔòCš]Î ‚(:Ò ª”èÔÛÍÀ¬# proc.memory.rssMB‚ 3172.13671875 disk.nvme0n1.out‚ 10721.71875 cpu‚25.63752627032885% disk./.usageGB‚2976.4864540100098 disk.md0.in‚ 64.35546875 disk.rbd0.out‚ 0.279296875 network.sent‚ 3.011534e+06 disk.sda1.in‚0 disk.sdb.in‚ 8.96484375 disk.sdb.out‚ 197.26171875 disk.rbd0.in‚0* proc.memory.percent‚19.361186027526855 disk.nvme1n1.in‚ 32.45703125) disk./.usagePercent‚83.22380701048107 disk.sdb1.in‚0 disk.sda.in‚ 55.390625 disk.sda2.in‚ 55.390625 disk.md0.out‚ 190.171875 disk.sdb2.in‚ 8.96484375 disk.sda2.out‚ 197.26171875( proc.memory.availableMB‚ 3952.3359375 disk.sda1.out‚0 disk.sdb2.out‚ 197.26171875 disk.rbd2.out‚ 0.279296875 proc.cpu.threads‚17 disk.sda.out‚ 197.26171875" disk.nvme1n1.out‚ 9696.80078125 disk.md0p1.out‚ 190.171875 disk.dm-0.out‚20418.51953125$ memory_percent‚75.87685585021973 network.recv‚608802 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.md0p1.in‚ 64.35546875 disk.dm-0.in‚ 253.17578125 disk.rbd2.in‚0KQdÏ ‚(:Ù ¹”èÔʬЪ% disk./.usageGB‚2976.4371337890625 disk.rbd0.in‚0" disk.nvme0n1.out‚ 10721.8828125 disk.md0p1.out‚ 191.81640625 cpu‚25.63668839313429 disk.dm-0.out‚ 20419.5078125 disk.sdb2.out‚198.9658203125 disk.sda2.out‚198.9658203125$ memory_percent‚75.87838172912598( proc.memory.availableMB‚ 3952.0859375 network.recv‚613858 disk.rbd0.out‚ 0.279296875 disk.sdb1.in‚0 disk.sda.out‚198.9658203125 disk.nvme1n1.out‚9697.625 disk.md0p1.in‚ 64.35546875 proc.cpu.threads‚17) disk./.usagePercent‚83.22242799646126 disk.sdb1.out‚0 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.md0.out‚ 191.81640625 disk.dm-0.in‚ 253.17578125 disk.rbd2.out‚ 0.279296875 disk.sda.in‚ 55.390625 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.96484375 disk.sdb.out‚198.9658203125* proc.memory.percent‚19.361186027526855 network.sent‚ 3.01619e+06 disk.sda1.out‚0 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 disk.rbd2.in‚0 disk.sdb2.in‚ 8.96484375# proc.memory.rssMB‚ 3172.13671875î=xˆŸÐ ‚(:” ¹”èÔè”Í« gpu.0.gpu‚84.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚225.753' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚56.438250000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚07é8+2Ñ - _wandbruntime‚1722  _runtime‚1722ûBÅÒ ¿ % lr-AdamW/pg2‚0.001109224237255748 trainer/global_step‚1549 % _timestamp‚1.7884800702224507e+09 _runtime‚1722.332796404 _step‚122 % lr-AdamW/pg1‚0.001109224237255748 â¤ÉÓ Ã % lr-AdamW/pg2‚0.001109224237255748 trainer/global_step‚1549 % _timestamp‚1.7884800702224507e+09 _runtime‚1722.332796404 _step‚122 % lr-AdamW/pg1‚0.001109224237255748z«p“ô2Ô - _wandbruntime‚1722  _runtime‚1722y8,ÂÕ æO WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚213133276476416 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1837647589376 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚209568801772459 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚207880853057936 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1687150193283 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚209568003251219 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚8022355 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚181683962149888 trainer/global_step‚1549 % _timestamp‚1.7884800702235992e+09 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 _step‚123 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚25345381 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚542 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚17323568 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚62145451 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚27885628 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚183521449497088 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚181683987053568 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160242176_LÉâð'Ö êO KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚17323571 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚27885628 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚211440455324672 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚183521634642944 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚207880870097296 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚213134076992000 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚8021813 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1837487347200 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚27885630 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚25345926 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚545 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 _step‚123 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚25345381 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚542 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚17323568 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚62145451 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚27885628 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚183521449497088 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚181683987053568 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160242176 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚213133276476416 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1837647589376 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚209568801772459 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚207880853057936 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1687150193283 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚209568003251219 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚8022355 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚181683962149888 trainer/global_step‚1549 % _timestamp‚1.7884800702235992e+09 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 IDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚62161318 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚213267894656000 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚183636739425792 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚213267894656000 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1838793701888 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚25361598 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚181798130856448 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚17334328 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚211573206636544 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1694688019456 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚213267094127104 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚62184617 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚8026762 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228864 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚34281535 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1694688019456 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚505 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚208011520298336 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚27903080 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1693904529920 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚17334331 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚62184617 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1688994420697 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚25361090 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8027267 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 _step‚124 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚211573189597184 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1688212938609 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚34281535 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0Į̀XëÙ óM S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚213267094127104 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚62184617 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚8026762 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228864 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚34281535 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1694688019456 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚505 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚208011520298336 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚27903080 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1693904529920 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚17334331 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚62184617 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1688994420697 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚25361090 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8027267 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 _step‚124 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚211573189597184 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1688212938609 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚34281535 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1838633473024 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚209700514719033 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚34258238 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚181798105952768 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 $ _timestamp‚1.788480071051272e+09 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚62161318 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚213267894656000 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚183636739425792 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚213267894656000 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1838793701888 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚25361598 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚181798130856448 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚17334328 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚211573206636544 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1694688019456 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400|ø&Ò2Ú - _wandbruntime‚1723  _runtime‚1723D!¯b\Û Ö 0loss/FBt2/assignment_loss‚0.4769363214754241 /loss/FRt3/detection_loss‚3.1208462485900292 0loss/SRqqt3/detection_loss‚2.765956796575011 _step‚125 2loss/SRqqt2/assignment_loss‚1.5627055804366652 0loss/FBt3/assignment_loss‚0.0988077453161496 /loss/FBt2/detection_loss‚2.5623340501504788 /loss/FBt4/detection_loss‚2.8489872647656336 trainer/global_step‚1549 0loss/FRt1/assignment_loss‚1.5154057228565216 1loss/FBt1/assignment_loss‚0.23554458325395158 0loss/SRqqt4/detection_loss‚2.093262449111024 epoch‚2 /loss/FRt1/detection_loss‚1.6575590646639466 1loss/SRqqt1/detection_loss‚1.0450486831642962 /loss/FRt2/detection_loss‚2.3550566377178317 /loss/FBt1/detection_loss‚0.4993966591803456 % _timestamp‚1.7884800710536234e+09 2loss/SRqqt1/assignment_loss‚1.0195435548822085 /loss/FRt4/detection_loss‚2.0402644480872936 %loss/total_loss‚44.60795851416558 _runtime‚1723.163658703 0loss/FRt3/assignment_loss‚3.4853879740604987 2loss/SRqqt4/assignment_loss‚1.7280846071774012 1loss/SRqqt2/detection_loss‚1.7679710949244707 .loss/FBt3/detection_loss‚2.740790445696224 1loss/SRqqt3/assignment_loss‚1.726612301772101 1loss/FBt4/assignment_loss‚0.11103966120733982 /loss/FRt2/assignment_loss‚3.344856631371283 0loss/FRt4/assignment_loss‚3.8055599877294504h*`Ü Ú 0loss/FBt2/assignment_loss‚0.4769363214754241 /loss/FRt3/detection_loss‚3.1208462485900292 0loss/SRqqt3/detection_loss‚2.765956796575011 _step‚125 2loss/SRqqt2/assignment_loss‚1.5627055804366652 0loss/FBt3/assignment_loss‚0.0988077453161496 /loss/FBt2/detection_loss‚2.5623340501504788 /loss/FBt4/detection_loss‚2.8489872647656336 trainer/global_step‚1549 0loss/FRt1/assignment_loss‚1.5154057228565216 1loss/FBt1/assignment_loss‚0.23554458325395158 0loss/SRqqt4/detection_loss‚2.093262449111024 epoch‚2 /loss/FRt1/detection_loss‚1.6575590646639466 1loss/SRqqt1/detection_loss‚1.0450486831642962 /loss/FRt2/detection_loss‚2.3550566377178317 /loss/FBt1/detection_loss‚0.4993966591803456 % _timestamp‚1.7884800710536234e+09 2loss/SRqqt1/assignment_loss‚1.0195435548822085 /loss/FRt4/detection_loss‚2.0402644480872936 %loss/total_loss‚44.60795851416558 _runtime‚1723.163658703 0loss/FRt3/assignment_loss‚3.4853879740604987 2loss/SRqqt4/assignment_loss‚1.7280846071774012 1loss/SRqqt2/detection_loss‚1.7679710949244707 .loss/FBt3/detection_loss‚2.740790445696224 1loss/SRqqt3/assignment_loss‚1.726612301772101 1loss/FBt4/assignment_loss‚0.11103966120733982 /loss/FRt2/assignment_loss‚3.344856631371283 0loss/FRt4/assignment_loss‚3.8055599877294504}ƒV¼•Ý ‚(:Š È”èÔ©ÿñ« gpu.0.gpu‚77.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚244.971' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚61.24275 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0.XÃwnÞ ‚(:ã È”èÔƶ¦¬ disk.md0p1.out‚ 193.3671875 disk.nvme0n1.in‚ 220.71875 disk.sdb2.in‚ 8.96484375" disk.nvme0n1.out‚ 10798.9453125 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚200.58056640625$ memory_percent‚75.87828636169434 cpu‚25.637034615921525 network.sent‚ 3.034204e+06) disk./.usagePercent‚83.19484174307543% disk./.usageGB‚2975.4505157470703 disk.md0.out‚ 193.3671875 disk.rbd0.out‚ 0.279296875 disk.sda.in‚ 55.390625 disk.sda1.in‚0( proc.memory.availableMB‚ 3952.1015625 disk.sdb1.in‚0 disk.sda.out‚200.58056640625 disk.sda1.out‚0 proc.cpu.threads‚17! disk.sda2.out‚200.58056640625 disk.md0.in‚ 64.35546875 disk.md0p1.in‚ 64.35546875 disk.rbd0.in‚0 disk.sda2.in‚ 55.390625 disk.dm-0.out‚20640.72265625 disk.rbd2.out‚ 0.279296875 disk.sdb1.out‚0 disk.sdb.in‚ 8.96484375# proc.memory.rssMB‚ 3172.13671875* proc.memory.percent‚19.361186027526855 network.recv‚618070 disk.dm-0.in‚ 253.17578125 disk.rbd2.in‚0" disk.nvme1n1.out‚ 9841.77734375! disk.sdb2.out‚200.58056640625Øïýÿ•ß ‚(:Š ×”èÔ¬ç« gpu.0.gpu‚71.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚213.331' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.33275 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0«LZÌlà ‚(:á ×”èÔ‘ëâ« disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.out‚20793.61328125 network.recv‚623268 disk.sdb1.out‚0 disk.sda.out‚202.4306640625 disk.md0.in‚ 64.35546875 disk.rbd2.out‚ 0.279296875 proc.cpu.threads‚17 disk.sdb1.in‚0 disk.md0.out‚ 195.16796875) proc.memory.availableMB‚ 3952.09765625 cpu‚25.637300931897563 disk.sda1.out‚0 disk.sdb2.in‚ 8.96484375* proc.memory.percent‚19.361186027526855 network.sent‚ 3.110331e+06 disk.sdb.out‚202.4306640625 disk.sdb2.out‚202.4306640625 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125 disk.rbd2.in‚0# proc.memory.rssMB‚ 3172.13671875) disk./.usagePercent‚83.19576393003615" disk.nvme0n1.out‚ 10830.4140625 disk.rbd0.out‚ 0.279296875$ memory_percent‚75.87831020355225 disk.nvme0n1.in‚ 220.71875" disk.nvme1n1.out‚ 9963.19921875 disk.sdb.in‚ 8.96484375 disk.md0p1.in‚ 64.35546875$ disk./.usageGB‚2975.483497619629 disk.sda.in‚ 55.390625 disk.sda2.in‚ 55.390625 disk.sda2.out‚202.4306640625 disk.md0p1.out‚ 195.16796875œø•á ‚(:Š æ”èÔ€óŬ gpu.0.gpu‚85.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚232.273' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.06825 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0õ Òaâ ‚(:Ö æ”èԯ׋® disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875) disk./.usagePercent‚83.19838649919996 network.recv‚626935 disk.sdb.in‚ 8.96484375 cpu‚25.63719796760346 disk.sda1.in‚0 disk.sdb2.in‚ 8.96484375 disk.sda2.in‚ 55.390625 disk.md0p1.out‚196.5$ memory_percent‚75.87602138519287# proc.memory.rssMB‚ 3172.13671875 proc.cpu.threads‚17# disk.nvme0n1.out‚10888.19140625! disk.sdb2.out‚203.82666015625 disk.rbd0.out‚ 0.279296875 disk.dm-0.in‚ 253.17578125 disk.sdb1.in‚0 disk.sda.in‚ 55.390625! disk.sda2.out‚203.82666015625 disk.md0.in‚ 64.35546875 disk.md0.out‚196.5 disk.md0p1.in‚ 64.35546875 disk.rbd2.out‚ 0.279296875 disk.sdb1.out‚0 disk.sda.out‚203.82666015625 disk.nvme1n1.in‚ 32.45703125! disk.nvme1n1.out‚ 9963.2890625) proc.memory.availableMB‚ 3952.47265625* proc.memory.percent‚19.361186027526855 network.sent‚ 3.115497e+06 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sdb.out‚203.82666015625$ disk./.usageGB‚2975.577293395996 disk.dm-0.out‚20851.48046875,AîÔã ‚(:‰ õ”èÔÐœ¾« gpu.0.gpu‚26.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚198.465' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚49.61625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0U6õÎcä ‚(:Ø õ”èÔÎþõ¬! disk.nvme0n1.out‚ 11003.984375 cpu‚25.636785930107127# disk.nvme1n1.out‚10080.19140625) disk./.usagePercent‚83.20537585720936 disk.rbd0.out‚ 0.279296875 disk.sda.in‚ 55.390625 disk.sdb.out‚205.4404296875# memory_percent‚75.8781909942627* proc.memory.percent‚19.361186027526855 disk.sdb2.in‚ 8.96484375 disk.sda2.out‚205.4404296875 disk.md0.in‚ 64.35546875 disk.dm-0.out‚21084.17578125 disk.rbd2.in‚0 disk.sda1.in‚0 disk.sdb2.out‚205.4404296875% disk./.usageGB‚2975.8272666931152 disk.md0.out‚198.0625 disk.dm-0.in‚ 253.17578125 disk.rbd2.out‚ 0.279296875 disk.sda.out‚205.4404296875( proc.memory.availableMB‚ 3952.1171875# proc.memory.rssMB‚ 3172.13671875 proc.cpu.threads‚17 disk.sda2.in‚ 55.390625 disk.md0p1.in‚ 64.35546875 disk.sda1.out‚0 network.sent‚ 3.119909e+06 network.recv‚631547 disk.md0p1.out‚198.0625 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.96484375 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sdb1.out‚0N.ù2å - _wandbruntime‚1772  _runtime‚1772BûiXÆæ À $ _timestamp‚1.788480120733002e+09 _runtime‚1772.843792079 _step‚126 & lr-AdamW/pg1‚0.0011000353787989842 & lr-AdamW/pg2‚0.0011000353787989842 trainer/global_step‚1599 O}5Êç Ä & lr-AdamW/pg1‚0.0011000353787989842 & lr-AdamW/pg2‚0.0011000353787989842 trainer/global_step‚1599 $ _timestamp‚1.788480120733002e+09 _runtime‚1772.843792079 _step‚126~œºb‡2è - _wandbruntime‚1772  _runtime‚1772v‰i|ê'é äO MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚189286546729984 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚187391152293888 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 1895211387392 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1746182960128 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚552 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚28758228 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚555 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚8272322 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158145024 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚216154476262767 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1746182960128 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚35324302 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1746966436352 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚64082530 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚219824987354624 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚64105803 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚189286363681280 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚219824186839040 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚35347573 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1895369532416 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚28758230 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚17861568 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1740314631591 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 _runtime‚ 1772.84406837 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚218078003878912 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚8272874 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚35324302 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚28758228 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚218078003878912 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚219824987354624 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1746966436352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 trainer/global_step‚1599 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚26133890 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048704 $ _timestamp‚1.788480120733695e+09 _step‚127 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚35347573 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚219824186839040 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚218078020918272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1746182960128 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚552 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚28758228 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚555 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚8272322 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158145024 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚216154476262767 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1746182960128 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚35324302 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1746966436352 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚64082530 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚219824987354624 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚64105803 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚189286363681280 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚219824186839040 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚35347573 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1895369532416 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚28758230 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚17861568 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1740314631591 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 _runtime‚ 1772.84406837 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚218078003878912 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚8272874 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚35324302 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚28758228 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚218078003878912 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚219824987354624 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1746966436352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 trainer/global_step‚1599 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚26133890 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048704 $ _timestamp‚1.788480120733695e+09 _step‚127 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚35347573 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚219824186839040 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚218078020918272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 % _timestamp‚1.7884801215692022e+09 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚218210772230144 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚28775680 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚17872331 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚218210755190784 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚64121670 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 147645952 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1896529216512 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1741377376917 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚26149675 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚8277347 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1896381570560 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚64144969 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8277881 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚214544013310976 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚64121670 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1748032788480 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚17872328 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚35369287 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚187505321000448 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚216286189209341 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1747249298944 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 172549632 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚219958805018624 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚28775680 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚35345990 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚28775682 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚26150212 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 trainer/global_step‚1599 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚218210755190784 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1748032788480 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚187505296096768 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚214544030350336 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚64144969 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚189401677667328 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1742158859005 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1747249298944 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚219958805018624 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚537þžjeû&í õM N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚537 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 _runtime‚1773.679975156 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚218210772230144 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 % _timestamp‚1.7884801215692022e+09 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚218210772230144 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚28775680 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚17872331 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚218210755190784 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚64121670 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 147645952 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1896529216512 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1741377376917 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚26149675 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚8277347 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 1896381570560 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚64144969 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8277881 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚214544013310976 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚64121670 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1748032788480 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚17872328 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚35369287 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚187505321000448 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚216286189209341 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1747249298944 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 172549632 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚219958805018624 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚28775680 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚35345990 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚28775682 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚26150212 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 trainer/global_step‚1599 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚218210755190784 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1748032788480 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚187505296096768 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚214544030350336 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚64144969 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚189401677667328 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1742158859005 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1747249298944 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚219958805018624 FDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚193098342437888 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚29630830 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1799527729152 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚66042882 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚226515897717248 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚36435325 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚29630828 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚220945890201296 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1793479069899 trainer/global_step‚1649 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚528 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚195051679815168 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚29630830 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚224715569472512 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_poo‘l‚X”l.allocated‚ 1800311205376 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚195051496766464 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚224715569472512 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚26922533 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048704 % _timestamp‚1.7884801708643394e+09 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚36435325 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚220945873161936 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚36412054 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚226515097201664 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 1953312473600 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚226515097201664 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 _step‚131 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚18399568 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚36412054 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚66066155 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚224715586511872 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚18399571 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚8522965 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚226515097201664 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 _step‚131 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚18399568 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚36412054 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚66066155 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚224715586511872 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚18399571 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚8522965 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚193098342437888 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚29630830 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1799527729152 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚66042882 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚226515897717248 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚36435325 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚29630828 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚220945890201296 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1793479069899 trainer/global_step‚1649 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚528 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚195051679815168 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚29630830 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚224715569472512 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1800311205376 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚195051496766464 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚224715569472512 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚26922533 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048704 % _timestamp‚1.7884801708643394e+09 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521240 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚36435325 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚220945873161936 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200ƒ°Ø„õ2ý - _wandbruntime‚1823  _runtime‚1823’åö&þ ðM KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚26938822 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8528491 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚195166983137792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚29648280 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1801377557504 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚66105321 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚36457039 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚18410328 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646784 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚517 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚26938305 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚8527977 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚222871863699649 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚66082022 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚66082022 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚226649715381248 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1801377557504 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1794541815225 trainer/global_step‚1649 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚36433742 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚66105321 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1954471993344 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚36457039 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚226648914852352 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1800594067968 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚36433742 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1800594067968x(”à0ÿ õM ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _runtime‚1823.818255495 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚221076540402336 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1795323297313 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚29648282 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚193212486240768 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884801717072089e+09 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚224848337823744 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚193212511144448 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚66105321 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 1954471993344 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚36457039 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚226648914852352 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1800594067968 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚36433742 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1800594067968 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚26938822 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8528491 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚195166983137792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚29648280 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1801377557504 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚66105321 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783489536 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚36457039 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚18410328 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646784 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚517 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚26938305 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚8527977 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚222871863699649 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚66082022 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚66082022 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚226649715381248 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1801377557504 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1794541815225 trainer/global_step‚1649 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚36433742 Fz„Ø2Œ - _wandbruntime‚1872  _runtime‚1872ëÇqoì' æO YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚37499806 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚8773520 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚135 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚27710574 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚37523077 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚200816565884928 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚37523077 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚27711091 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1852872498176 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚233206808079872 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚30503430 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚18937568 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚8773006 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚229325825243383 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚1699 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853568 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚233206007564288 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚231353135066112 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1852872498176 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚198805557485568 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 % _timestamp‚1.7884802200744507e+09 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚231353152105472 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚68026507 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1852872498176 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚233206808079872 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚30503430 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚18937568 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚8773006 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚229325825243383 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚1699 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853568 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚233206007564288 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚231353135066112 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1852872498176 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚198805557485568 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 % _timestamp‚1.7884802200744507e+09 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚231353152105472 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚68026507 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚37523077 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200‡š}€2 - _wandbruntime‚1873  _runtime‚1873x}Ž[Ó ðM L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚30520882 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚27726321 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 2åxW~#!1653231616 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚231485903417344 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2012163773952 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚200931682027008 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1848487735621 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚136 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2012005642240 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚229457538189957 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚68042374 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8778509 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚227609033414976 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1847706253533 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚68065673 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚68065673 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚233340625743872 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚37544791 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚233340625743872 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1854722326528 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 _runtime‚1873.050181753 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚233339825214976 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚30520882 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚198919701288448 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131712 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚231485886377984 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1853938836992 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚37521494 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚200931865062400 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚37521494 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183035392 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚198919676384768 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚227609050454336 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚68042374 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚18948331 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚30520880 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚229456739668509òÓDû&‘ õM _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚198919676384768 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚227609050454336 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚68042374 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚18948331 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚30520880 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚229456739668509 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚30520882 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚27726321 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚231485903417344 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2012163773952 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚200931682027008 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1848487735621 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚136 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2012005642240 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚229457538189957 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚68042374 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚8778509 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚227609033414976 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1847706253533 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚68065673 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚68065673 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚233340625743872 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚37544791 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚233340625743872 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1854722326528 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 _runtime‚1873.050181753 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚233339825214976 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚30520882 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚198919701288448 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131712 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚231485886377984 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1853938836992 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚37521494 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚200931865062400 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚37521494 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183035392ˆe.Žf2’ - _wandbruntime‚1873  _runtime‚1873¨¯dîX“ Ò /loss/FRt2/detection_loss‚2.7103076112028717 0loss/SRqqt2/detection_loss‚1.944489172155704 0loss/SRqqt4/detection_loss‚2.026492989764494 %loss/total_loss‚42.64857085213278 0loss/FRt4/assignment_loss‚3.1785859517429187 2loss/SRqqt1/assignment_loss‚0.9028463803245617 2loss/SRqqt3/assignment_loss‚1.9361066301870677 1loss/FBt3/assignment_loss‚0.15033830868573947 -loss/FRt4/detection_loss‚2.13190716671069 _step‚137 /loss/FRt3/assignment_loss‚3.035692938603461 trainer/global_step‚1699 _runtime‚1873.051245508 /loss/FRt3/detection_loss‚2.9179699858650565 /loss/FBt4/detection_loss‚2.5996731519699097 epoch‚2 % _timestamp‚1.7884802209411392e+09 0loss/FRt2/assignment_loss‚2.9395805500649117 2loss/SRqqt4/assignment_loss‚1.5695807835635016 0loss/SRqqt3/detection_loss‚2.323318301803536 .loss/FBt3/detection_loss‚2.520407795906067 .loss/FBt2/detection_loss‚2.861296738897051 0loss/FRt1/assignment_loss‚1.5393523483172706 1loss/SRqqt2/assignment_loss‚1.468820051469524 1loss/FBt1/assignment_loss‚0.16430710738835988 1loss/FBt2/assignment_loss‚0.16108856917500297 0loss/FBt4/assignment_loss‚0.2564535331136237 /loss/FRt1/detection_loss‚1.6355914191707321 1loss/SRqqt1/detection_loss‚0.9984896341477757 .loss/FBt1/detection_loss‚0.675873731902941!ôÞ]” × -loss/FRt4/detection_loss‚2.13190716671069 _step‚137 /loss/FRt3/assignment_loss‚3.035692938603461 trainer/global_step‚1699 _runtime‚1873.051245508 /loss/FRt3/detection_loss‚2.9179699858650565 /loss/FBt4/detection_loss‚2.5996731519699097 epoch‚2 % _timestamp‚1.7884802209411392e+09 0loss/FRt2/assignment_loss‚2.9395805500649117 2loss/SRqqt4/assignment_loss‚1.5695807835635016 0loss/SRqqt3/detection_loss‚2.323318301803536 .loss/FBt3/detection_loss‚2.520407795906067 .loss/FBt2/detection_loss‚2.861296738897051 0loss/FRt1/assignment_loss‚1.5393523483172706 1loss/SRqqt2/assignment_loss‚1.468820051469524 1loss/FBt1/assignment_loss‚0.16430710738835988 1loss/FBt2/assignment_loss‚0.16108856917500297 0loss/FBt4/assignment_loss‚0.2564535331136237 /loss/FRt1/detection_loss‚1.6355914191707321 1loss/SRqqt1/detection_loss‚0.9984896341477757 .loss/FBt1/detection_loss‚0.675873731902941 /loss/FRt2/detection_loss‚2.7103076112028717 0loss/SRqqt2/detection_loss‚1.944489172155704 0loss/SRqqt4/detection_loss‚2.026492989764494 %loss/total_loss‚42.64857085213278 0loss/FRt4/assignment_loss‚3.1785859517429187 2loss/SRqqt1/assignment_loss‚0.9028463803245617 2loss/SRqqt3/assignment_loss‚1.9361066301870677 1loss/FBt3/assignment_loss‚0.15033830868573947‰[b6´•• ‚(:Š Þ•èÔ°±ãª gpu.0.gpu‚66.0 gpu.0.memory‚15, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚222.743' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.68575 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0?uH˜g– ‚(:Ü Þ•èÔèä« disk.sda2.out‚ 217.501953125 disk.sdb.in‚ 8.96484375 disk.sdb.out‚ 217.501953125 disk.md0.out‚ 209.6640625 disk.dm-0.out‚ 22112.8203125# proc.memory.rssMB‚ 3172.13671875 cpu‚25.626183039983264 disk.sdb1.out‚0 disk.rbd0.out‚ 0.291015625 disk.rbd2.in‚0$ memory_percent‚75.87854862213135 network.recv‚661092 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 209.6640625 disk.rbd2.out‚ 0.353515625* proc.memory.percent‚19.361186027526855 network.sent‚ 3.320541e+06) disk./.usagePercent‚83.21061224937336 disk.sdb2.out‚ 217.501953125 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.dm-0.in‚ 253.17578125) proc.memory.availableMB‚ 3952.05859375 disk.sda.out‚ 217.501953125 disk.sdb2.in‚ 8.96484375 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sda.in‚ 55.390625 disk.sda1.out‚0# disk.nvme0n1.out‚12029.95703125# disk.nvme1n1.out‚10082.86328125 disk.md0p1.in‚ 64.35546875 proc.cpu.threads‚17$ disk./.usageGB‚2976.014545440674 disk.nvme1n1.in‚ 32.457031252ˆ•— ‚(:Š í•èÔÇÊ£« gpu.0.gpu‚52.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚226.703' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.67575 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 mæh˜ ‚(:Ý í•èÔõÑ‹¬ network.sent‚ 3.407612e+06 network.recv‚666693 disk.rbd2.in‚0 disk.sdb.in‚ 8.96484375# proc.memory.rssMB‚ 3172.13671875 proc.cpu.threads‚17 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125 disk.nvme0n1.in‚ 220.71875 disk.dm-0.out‚22316.25390625 disk.rbd2.out‚ 0.353515625 disk.sdb1.out‚0& proc.memory.availableMB‚ 3952.28125* proc.memory.percent‚19.361186027526855) disk./.usagePercent‚83.21236052215536 disk.md0.in‚ 64.35546875 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 211.859375 disk.sda1.out‚0 disk.nvme0n1.out‚ 12233.1875$ memory_percent‚75.87718963623047 disk.md0.out‚ 211.859375 disk.sda.in‚ 55.390625 disk.sda.out‚219.75439453125 disk.sda1.in‚0 disk.sda2.in‚ 55.390625 disk.sdb2.in‚ 8.96484375! disk.sda2.out‚219.75439453125% disk./.usageGB‚2976.0770721435547 disk.rbd0.out‚ 0.353515625 disk.sdb1.in‚0 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚10083.06640625 cpu‚25.625173550964586 disk.sdb.out‚219.75439453125! disk.sdb2.out‚219.75439453125–óþ+™ ‚(:… ü•èÔËÞÅ« gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0bª®„iš ‚(:Þ ü•èÔž´‚­ disk.dm-0.out‚22538.58984375 proc.cpu.threads‚17 network.recv‚670475 disk.sdb1.out‚0# disk.nvme0n1.out‚12455.33984375! disk.sdb2.out‚221.41552734375 disk.md0p1.in‚ 64.35546875 disk.nvme1n1.out‚10083.25 disk.sdb.out‚221.41552734375 cpu‚25.623923088878662 disk.rbd2.out‚ 0.4326171875 disk.sdb2.in‚ 8.96484375 disk.md0p1.out‚ 213.46484375 disk.rbd0.out‚ 0.353515625& proc.memory.availableMB‚ 3952.28125 network.sent‚ 3.41499e+06) disk./.usagePercent‚83.23157936345677$ disk./.usageGB‚2976.764430999756 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125! disk.sda2.out‚221.41552734375$ memory_percent‚75.87718963623047 disk.sdb1.in‚0 disk.sda.in‚ 55.390625 disk.sda2.in‚ 55.390625 disk.md0.out‚ 213.46484375 disk.dm-0.in‚ 253.17578125# proc.memory.rssMB‚ 3172.13671875* proc.memory.percent‚19.361186027526855 disk.sdb.in‚ 8.96484375 disk.sda1.in‚0 disk.md0.in‚ 64.35546875 disk.rbd0.in‚0 disk.sda.out‚221.41552734375 disk.sda1.out‚0RW'0•› ‚(:Š ‹–èÔ´ÊÀ« gpu.0.gpu‚80.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚168.051' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚42.01275 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚03[0pœ ‚(:å ‹–èÔÝö¼¬ network.sent‚ 3.419197e+06 network.recv‚674969 disk.sdb.out‚223.02587890625$ memory_percent‚75.87568759918213 proc.cpu.threads‚17! disk.sdb2.out‚223.02587890625 disk.md0p1.in‚ 64.35546875 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda.out‚223.02587890625* proc.memory.percent‚19.361209869384766 cpu‚25.62260420757104# disk.nvme1n1.out‚10083.36328125 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 disk.rbd0.out‚ 0.4326171875 disk.sda1.in‚0" disk.nvme0n1.out‚ 12550.7109375) proc.memory.availableMB‚ 3952.52734375 disk.md0.out‚ 215.01171875 disk.rbd0.in‚0! proc.memory.rssMB‚ 3172.140625) disk./.usagePercent‚83.23859794645197 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.out‚22634.07421875 disk.sda.in‚ 55.390625! disk.sda2.out‚223.02587890625 disk.md0p1.out‚ 215.01171875 disk.sdb1.in‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875$ disk./.usageGB‚2977.015449523926 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.dm-0.in‚ 253.17578125 disk.rbd2.out‚ 0.4326171875÷ÇýV2 - _wandbruntime‚1925  _runtime‚1925|ÃäÇž Á & lr-AdamW/pg1‚0.0010699868152048775 & lr-AdamW/pg2‚0.0010699868152048775 trainer/global_step‚1749 % _timestamp‚1.7884802736030447e+09 _runtime‚1925.713350581 _step‚138®Œ6£ÌŸ Æ trainer/global_step‚1749 % _timestamp‚1.7884802736030447e+09 _runtime‚1925.713350581 _step‚138 & lr-AdamW/pg1‚0.0010699868152048775 & lr-AdamW/pg2‚0.0010699868152048775Š³QZ2  - _wandbruntime‚1925  _runtime‚19258Õî¡ åO KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚69986859 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚234010893265936 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚1749 % _timestamp‚1.7884802736046298e+09 _runtime‚ 1925.71543108 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚31376028 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚235910701212451 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚31376028 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚28500163 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚31376030 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1900589428395 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚38587558 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚38610829 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚9024054 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚204512722725888 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚239896917926912 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2068630603776 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1906217267200 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚239896917926912 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.p^,½\eak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚237990717699072 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚234010910305296 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚239897718442496 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚38587558 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚237990700659712 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1907000743424 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2068778263040 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚541 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚538 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚38610829 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚237990717699072 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚28499622 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1899807946515 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚19475571 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147659264 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚237990700659712 _step‚139 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚239897718442496 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273ÊRð'¢ êO IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚541 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚538 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚38610829 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚237990717699072 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚28499622 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1899807946515 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚19475571 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147659264 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚237990700659712 _step‚139 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚239897718442496 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚69986859 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚234010893265936 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚1749 % _timestamp‚1.7884802736046298e+09 _runtime‚ 1925.71543108 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚31376028 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚235910701212451 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚31376028 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚28500163 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚31376030 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1900589428395 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚38587558 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚38610829 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚9024054 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚204512722725888 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚239896917926912 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2068630603776 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1906217267200 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚239896917926912 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚237990717699072 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚234010910305296 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚239897718442496 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚38587558 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚237990700659712 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1907000743424 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2068778263040 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200‹·:9&2£ - _wandbruntime‚1926  _runtime‚1926&òQö&¤ ðM MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚204626866528768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚238123469010944 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2069774616064 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚38632543 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚38609246 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚19486331 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚31393482 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229696 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚19486328 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚240031536106496 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚70026025 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚38632543 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚543 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2069936942080 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚236042414158817 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚204626891432448 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚234141560506336 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 _runtime‚1926.581425639 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚70002726 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚546 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚70002726 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚70026025 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚240031536106496 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚28515912 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚206696828374528 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚238123469010944 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚31393480 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚31393482 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚38609246 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1901652173929 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚9029581 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚28515366 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 % _timestamp‚1.7884802744707627e+09Òw¢ƒi¥ õM I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚19486328 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚240031536106496 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚70026025 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚38632543 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚543 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2069936942080 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚236042414158817 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚204626891432448 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚234141560506336 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 _runtime‚1926.581425639 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚70002726 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚546 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚70002726 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚70026025 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23299 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚240031536106496 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚28515912 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚206696828374528 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚238123469010944 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚31393480 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚31393482 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚38609246 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 1901652173929 JBDeviceStatsMonitor.on_train_batch_enH ƒ’ d/segment.small_pool.allocated‚475 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚9029581 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚28515366 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 % _timestamp‚1.7884802744707627e+09 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚204626866528768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚238123469010944 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2069774616064 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚38632543 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚38609246 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚19486331 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚31393482 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229696 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837Œ+£’ù2¦ - _wandbruntime‚1926  _runtime‚1926æ3CR§ Ì 2loss/SRqqt1/assignment_loss‚0.8658467760821148 1loss/FBt3/assignment_loss‚0.11553398851330192 .loss/FBt1/detection_loss‚0.761244987210272 _runtime‚1926.583157186 /loss/FRt4/assignment_loss‚3.465548704067866 /loss/FRt2/detection_loss‚2.2465751285248614 %loss/total_loss‚42.21829250185269 1loss/SRqqt1/detection_loss‚0.9883823892705037 1loss/SRqqt2/detection_loss‚1.5940550045192647 % _timestamp‚1.7884802744731011e+09 .loss/FRt1/detection_loss‚1.746791990704081 0loss/FRt1/assignment_loss‚1.7855137854479672 1loss/SRqqt3/assignment_loss‚2.090547892368502 1loss/FBt2/assignment_loss‚0.12883811105566564 .loss/SRqqt4/detection_loss‚2.3335977188415 .loss/FRt3/detection_loss‚2.772124751194103 0loss/SRqqt3/detection_loss‚2.472885310176819 trainer/global_step‚1749 .loss/FBt2/detection_loss‚1.661559636592865 /loss/FBt3/detection_loss‚2.4401072902338847 /loss/FBt4/detection_loss‚2.4181654361578135 epoch‚2 0loss/FBt4/assignment_loss‚0.0989907277533068 ,loss/FRt2/assignment_loss‚2.777116467344 2loss/SRqqt2/assignment_loss‚1.6188324324431873 2loss/SRqqt4/assignment_loss‚1.8796638414884608 _step‚141 /loss/FRt3/assignment_loss‚3.733519089383048 1loss/FBt1/assignment_loss‚0.02729386907125897 .loss/FRt4/detection_loss‚2.195557173408036Ù³ÜÙW¨ Ñ 2loss/SRqqt1/assignment_loss‚0.8658467760821148 1loss/FBt3/assignment_loss‚0.11553398851330192 .loss/FBt1/detection_loss‚0.761244987210272 _runtime‚1926.583157186 /loss/FRt4/assignment_loss‚3.465548704067866 /loss/FRt2/detection_loss‚2.2465751285248614 %loss/total_loss‚42.21829250185269 1loss/SRqqt1/detection_loss‚0.9883823892705037 1loss/SRqqt2/detection_loss‚1.5940550045192647 % _timestamp‚1.7884802744731011e+09 .loss/FRt1/detection_loss‚1.746791990704081 0loss/FRt1/assignment_loss‚1.7855137854479672 1loss/SRqqt3/assignment_loss‚2.090547892368502 1loss/FBt2/assignment_loss‚0.12883811105566564 .loss/SRqqt4/detection_loss‚2.3335977188415 .loss/FRt3/detection_loss‚2.772124751194103 0loss/SRqqt3/detection_loss‚2.472885310176819 trainer/global_step‚1749 .loss/FBt2/detection_loss‚1.661559636592865 /loss/FBt3/detection_loss‚2.4401072902338847 /loss/FBt4/detection_loss‚2.4181654361578135 epoch‚2 0loss/FBt4/assignment_loss‚0.0989907277533068 ,loss/FRt2/assignment_loss‚2.777116467344 2loss/SRqqt2/assignment_loss‚1.6188324324431873 2loss/SRqqt4/assignment_loss‚1.8796638414884608 _step‚141 /loss/FRt3/assignment_loss‚3.733519089383048 1loss/FBt1/assignment_loss‚0.02729386907125897 .loss/FRt4/detection_loss‚2.195557173408036þ“•© ‚(:Š š–èÔƵµ« gpu.0.gpu‚57.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚210.057' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.51425 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ì‘zlkª ‚(:à š–èÔÞ´À« disk.md0.in‚ 64.35546875' proc.memory.availableMB‚ 3951.953125 cpu‚25.621570972353922 network.sent‚ 3.424185e+06 disk.rbd0.out‚ 0.4326171875 disk.dm-0.out‚22894.05078125 disk.rbd2.in‚0 disk.sdb.out‚224.52587890625 proc.cpu.threads‚17 network.recv‚678004# disk.nvme0n1.out‚12810.37890625! disk.nvme1n1.out‚ 10083.671875 disk.md0.out‚ 216.453125$ disk./.usageGB‚2977.014430999756 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125! proc.memory.rssMB‚ 3172.140625 disk.md0p1.out‚ 216.453125 disk.sda2.in‚ 55.390625) disk./.usagePercent‚83.23856946808989 disk.md0p1.in‚ 64.35546875 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sda.in‚ 55.390625 disk.sda1.out‚0$ memory_percent‚75.87919235229492 disk.rbd2.out‚ 0.49560546875 disk.sda.out‚224.52587890625 disk.sda1.in‚0 disk.sdb2.in‚ 8.96484375* proc.memory.percent‚19.361209869384766 disk.dm-0.in‚ 253.17578125 disk.sdb.in‚ 8.96484375 disk.nvme0n1.in‚ 220.71875! disk.sdb2.out‚224.52587890625! disk.sda2.out‚224.52587890625ó¥¥xg« ‚(:Ü ©–èÔüÂÕª disk.rbd2.in‚0! disk.nvme1n1.out‚ 10083.828125$ memory_percent‚75.87723731994629$ disk./.usageGB‚2977.014488220215 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625! disk.sda2.out‚226.42822265625 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 218.296875 disk.sdb1.in‚0 disk.nvme0n1.out‚ 13058.4375 disk.rbd2.out‚ 0.49560546875 disk.sda1.in‚0 disk.sda1.out‚0( proc.memory.availableMB‚ 3952.2734375 network.recv‚683734 disk.sdb.out‚226.42822265625 disk.sdb2.in‚ 8.96484375 disk.md0.out‚ 218.296875 disk.dm-0.out‚ 23142.265625 disk.sda.in‚ 55.390625* proc.memory.percent‚19.361257553100586 proc.cpu.threads‚17 disk.md0p1.in‚ 64.35546875 disk.sdb1.out‚0) disk./.usagePercent‚83.23857106799788 disk.rbd0.out‚ 0.49560546875 disk.nvme1n1.in‚ 32.45703125 disk.nvme0n1.in‚ 220.71875! disk.sdb2.out‚226.42822265625 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125 disk.sda.out‚226.42822265625" proc.memory.rssMB‚ 3172.1484375 cpu‚25.62054957905858 network.sent‚ 3.510387e+06z󧕬 ‚(:Š ©–èÔã䎫 gpu.0.gpu‚57.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚206.203' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.55075 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ØÀ”­ ‚(:‰ ¸–èÔÏÝ« gpu.0.gpu‚10.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚194.453' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚48.61325 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ˆiSáf® ‚(:Û ¸–èÔÃȸ­ disk.dm-0.out‚23355.74609375 disk.rbd2.in‚0 disk.rbd2.out‚ 0.55859375 disk.nvme1n1.in‚ 32.45703125 disk.nvme0n1.in‚ 220.71875 disk.md0p1.in‚ 64.35546875 disk.dm-0.in‚ 253.17578125 disk.sda.in‚ 55.390625 disk.sda1.in‚0 network.sent‚ 3.517772e+06$ disk./.usageGB‚2977.014430999756 disk.rbd0.in‚0* proc.memory.percent‚19.361257553100586 disk.sdb2.in‚ 8.96484375 disk.sdb2.out‚228.0517578125 disk.md0.out‚ 219.87109375" proc.memory.rssMB‚ 3172.1484375 disk.sdb1.out‚0# disk.nvme1n1.out‚10083.99609375$ memory_percent‚75.87800025939941( proc.memory.availableMB‚ 3952.1484375 disk.sda1.out‚0 network.recv‚687244 disk.sdb.out‚228.0517578125 disk.sda2.in‚ 55.390625 disk.sdb1.in‚0 proc.cpu.threads‚17 disk.sdb.in‚ 8.96484375 disk.sda2.out‚228.0517578125 disk.rbd0.out‚ 0.49560546875 disk.nvme0n1.out‚13271.75) disk./.usagePercent‚83.23856946808989 disk.md0.in‚ 64.35546875 disk.sda.out‚228.0517578125 cpu‚25.61957218784502 disk.md0p1.out‚ 219.87109375aKR·•¯ ‚(:Š Ç–èÔîÛÍ« gpu.0.gpu‚83.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚232.605' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.15125 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ùõ„j° ‚(:ß Ç–èÔ¬‚ଠdisk.sdb1.in‚0 disk.nvme1n1.in‚ 32.45703125 proc.cpu.threads‚17 disk.rbd0.out‚ 0.49560546875 disk.sda.in‚ 55.390625 disk.sda2.in‚ 55.390625! disk.sda2.out‚229.84521484375* proc.memory.percent‚19.361257553100586$ disk./.usageGB‚2976.486846923828 disk.sdb.out‚229.84521484375 disk.dm-0.out‚ 23604.578125 disk.nvme0n1.in‚ 220.71875 disk.nvme0n1.out‚ 13520.46875! disk.nvme1n1.out‚ 10084.109375! disk.sdb2.out‚229.84521484375 disk.sda.out‚229.84521484375 disk.sdb.in‚ 8.96484375$ memory_percent‚75.87716579437256 disk.rbd2.out‚ 0.55859375 disk.sda1.in‚0 disk.sdb2.in‚ 8.96484375 disk.md0.out‚ 221.57421875 disk.md0p1.out‚ 221.57421875 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125" proc.memory.rssMB‚ 3172.1484375 network.sent‚ 3.521979e+06) disk./.usagePercent‚83.22381799651588 disk.sda1.out‚0 disk.md0.in‚ 64.35546875 disk.md0p1.in‚ 64.35546875) proc.memory.availableMB‚ 3952.28515625 network.recv‚691864 disk.rbd2.in‚0 disk.sdb1.out‚0 cpu‚25.61832914573345ÌfÞ-2± - _wandbruntime‚1980  _runtime‚1980cÆÜBƲ À % _timestamp‚1.7884803281376555e+09 _runtime‚ 1980.24970862 _step‚142 & lr-AdamW/pg1‚0.0010591711747974621 & lr-AdamW/pg2‚0.0010591711747974621 trainer/global_step‚17998sG·Ë³ Å _step‚142 & lr-AdamW/pg1‚0.0010591711747974621 & lr-AdamW/pg2‚0.0010591711747974621 trainer/global_step‚1799 % _timestamp‚1.7884803281376555e+09 _runtime‚ 1980.24970862ŽPÿuò2´ - _wandbruntime‚1980  _runtime‚1980?Û ì'µ æO \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2126570157056 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚32248628 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚210219937773568 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚39675310 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1952972384823 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884803281387162e+09 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚39675310 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚244628266253312 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚244628266253312 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚246587828289536 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚246588628805120 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚29288527 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚242497174223999 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚240543403317936 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚71923938 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚32248630 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚246587828289536 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1953753866703 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚39698581 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1959562036224 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1960345512448 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1960345512448 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚20013568 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2126713622016 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚240543420357296 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _runtime‚1980.249872821 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚32248628 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚513 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚71947211 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚242496375702759 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 _step‚143 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚244628283292672 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚32248630 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚510 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚212346651395584 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚212346483026944 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1959562036224 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚39698581 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚20013571 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚9274956 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚9274446 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚244628283292672 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚29288014 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚210219912869888 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 168368640 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200|¥•5?'¶ ëO TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚510 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚212346651395584 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚212346483026944 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488128 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 1959562036224 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚39698581 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23271 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚20013571 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚9274956 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23273 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚9274446 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚244628283292672 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚29288014 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚210219912869888 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 168368640 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2126570157056 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚32248628 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437184 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚210219937773568 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800515584 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚39675310 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 1952972384823 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884803281387162e+09 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚39675310 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28165 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23273 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚244628266253312 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104837 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28432 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚244628266253312 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚246587828289536 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23271 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚246588628805120 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚29288527 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚242497174223999 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚240543403317936 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚71923938 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚32248630 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚246587828289536 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476224 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 1953753866703 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚39698581 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488128 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 1959562036224 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481880 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437184 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 1960345512448 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800515584 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 1960345512448 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚20013568 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2126713622016 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚240543420357296 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _runtime‚1980.249872821 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476224 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚32248628 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚513 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚71947211 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚242496375702759 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28432 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420788 _step‚143 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28165 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚24462828329267ú -˲2 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚32248630 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200ôƒŒª2· - _wandbruntime‚1981  _runtime‚1981Y™ø§õ&¸ ïM ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚244761034604544 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚32266080 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚9279405 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521448 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚240674070558336 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚39720295 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚39696998 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚244761017565184 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚32266082 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚210334081576448 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚246721645940224 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1961411864576 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1954035130149 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚39720295 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚32266080 PDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚20024328 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 _step‚144 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚71963078 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1960628375040 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚210334056672768 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 trainer/global_step‚1799 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚244761034604544 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚29303733 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚244761017565184 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚29304254 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1961411864576 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚212461780618752 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180938240 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2127879980544 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚20024331 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚240674053518976 $ _timestamp‚1.788480329124986e+09 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚242628887170573 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚71986377 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1960628375040 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚71986377 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚246722446469120 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚212461961556992 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034560 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 _runtime‚1981.236255225 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚32266082 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23297 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 1960628375040 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚71986377 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482088 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚246722446469120 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚212461961556992 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034560 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 _runtime‚1981.236255225 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚32266082 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104837 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚240674070558336 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚39720295 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚39696998 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚244761017565184 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚32266082 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800528896 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚210334081576448 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437184 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚246721645940224 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 1961411864576 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23297 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 1954035130149 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800528896 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚39720295 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420788 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚32266080 PDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚20024328 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 _step‚144 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488128 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚71963078 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783489536 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 1960628375040 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚210334056672768 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 trainer/global_step‚1799 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚244761034604544 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚29303733 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28432 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚244761017565184 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚29304254 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 1961411864576 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚212461780618752 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180938240 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437184 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28165 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2127879980544 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28432 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚20024331 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚240674053518976 $ _timestamp‚1.788480329124986e+09 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488128 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚242628887170573 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚71986377 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600vwÀÔ2º - _wandbruntime‚1981  _runtime‚1981>4ê5[» Õ /loss/FRt2/assignment_loss‚2.521229031774187 /loss/FRt3/assignment_loss‚3.217378058990875 /loss/FRt2/detection_loss‚2.2181768750714275 /loss/FBt4/detection_loss‚2.1043592989444733 0loss/FRt4/assignment_loss‚3.5318742268360577 1loss/SRqqt2/detection_loss‚1.5960784971826059 % _timestamp‚1.7884803291273394e+09 1loss/FBt1/assignment_loss‚0.12246236290825711 /loss/FBt3/assignment_loss‚0.382433425852408 _runtime‚1981.237534871 2loss/SRqqt1/assignment_loss‚0.8660648332524072 2loss/SRqqt2/assignment_loss‚1.5347802704760343 -loss/FRt4/detection_loss‚2.16920284207579 1loss/SRqqt3/detection_loss‚2.4205869819436754 /loss/FRt1/detection_loss‚1.6130539453946626 .loss/FBt2/detection_loss‚2.513071745634079 .loss/FBt3/detection_loss‚2.837460611263911 1loss/FBt2/assignment_loss‚0.08609899535885132 1loss/FBt4/assignment_loss‚0.35258591955689556 /loss/FRt3/detection_loss‚2.6377011661405687 1loss/SRqqt1/detection_loss‚1.1668882398501685 1loss/SRqqt4/detection_loss‚2.2681067318600765 %loss/total_loss‚41.73147253295627 epoch‚2 trainer/global_step‚1799 /loss/FBt1/detection_loss‚0.7050580049893169 _step‚145 2loss/SRqqt3/assignment_loss‚1.8196467413240438 2loss/SRqqt4/assignment_loss‚1.4156074957812534 0loss/FRt1/assignment_loss‚1.6315662304942424¡²`¼ Ú /loss/FRt2/assignment_loss‚2.521229031774187 /loss/FRt3/assignment_loss‚3.217378058990875 /loss/FRt2/detection_loss‚2.2181768750714275 /loss/FBt4/detection_loss‚2.1043592989444733 0loss/FRt4/assignment_loss‚3.5318742268360577 1loss/SRqqt2/detection_loss‚1.5960784971826059 % _timestamp‚1.7884803291273394e+09 1loss/FBt1/assignment_loss‚0.12246236290825711 /loss/FBt3/assignment_loss‚0.382433425852408 _runtime‚1981.237534871 2loss/SRqqt1/assignment_loss‚0.8660648332524072 2loss/SRqqt2/assignment_loss‚1.5347802704760343 -loss/FRt4/detection_loss‚2.16920284207579 1loss/SRqqt3/detection_loss‚2.4205869819436754 /loss/FRt1/detection_loss‚1.6130539453946626 .loss/FBt2/detection_loss‚2.513071745634079 .loss/FBt3/detection_loss‚2.837460611263911 1loss/FBt2/assignment_loss‚0.08609899535885132 1loss/FBt4/assignment_loss‚0.35258591955689556 /loss/FRt3/detection_loss‚2.6377011661405687 1loss/SRqqt1/detection_loss‚1.1668882398501685 1loss/SRqqt4/detection_loss‚2.2681067318600765 %loss/total_loss‚41.73147253295627 epoch‚2 trainer/global_step‚1799 /loss/FBt1/detection_loss‚0.7050580049893169 _step‚145 2loss/SRqqt3/assignment_loss‚1.8196467413240438 2loss/SRqqt4/assignment_loss‚1.4156074957812534 0loss/FRt1/assignment_loss‚1.6315662304942424‘^GMÆ“½ ‚(:ˆ Ö–èÔŠ¢ãª gpu.0.gpu‚53.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.966' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.9915 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0s#ëe¾ ‚(:Ú Ö–èÔÁ™ƒ° disk.sdb1.in‚0* proc.memory.percent‚19.361257553100586 disk.sdb.out‚231.7431640625 network.recv‚695896 disk.rbd0.out‚ 0.55859375 disk.rbd2.in‚0 disk.md0.in‚ 64.35546875 disk.md0p1.in‚ 64.35546875 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.96484375 proc.cpu.threads‚17 disk.sda2.out‚231.7431640625 disk.rbd2.out‚ 0.55859375 disk.sdb1.out‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875" disk.nvme1n1.out‚ 10084.2890625 disk.sdb2.out‚231.7431640625 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 23749.4296875 disk.sda.in‚ 55.390625 disk.sda.out‚231.7431640625 disk.sda1.in‚0! disk.nvme0n1.out‚ 13665.140625$ memory_percent‚75.87802410125732 network.sent‚ 3.568275e+06$ disk./.usageGB‚2976.437000274658 disk.sda2.in‚ 55.390625" proc.memory.rssMB‚ 3172.1484375 disk.sdb2.in‚ 8.96484375 disk.md0.out‚ 223.3984375 disk.rbd0.in‚0) proc.memory.availableMB‚ 3952.14453125 cpu‚25.618722829158628) disk./.usagePercent‚83.22242426334263 disk.md0p1.out‚ 223.3984375IF=8’¿ ‚(:‡ å–èÔüŒÊ¬ gpu.0.gpu‚90.0 gpu.0.memory‚15, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¨‡/cÀ ‚(:Ø å–èÔ¼Èþ¬ disk.sda.out‚ 233.275390625 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.in‚ 8.96484375* proc.memory.percent‚19.298458099365234 disk.md0p1.out‚ 224.87109375 disk.rbd0.in‚0 cpu‚25.65116117701888" disk.nvme0n1.out‚ 13886.1640625 disk.sdb1.in‚0 disk.sda.in‚ 55.390625 disk.md0.out‚ 224.87109375% disk./.usageGB‚2976.5121994018555 disk.rbd2.out‚ 0.55859375# disk.nvme1n1.out‚10084.42578125 disk.sdb.out‚ 233.275390625 disk.sdb2.out‚ 233.275390625 disk.md0.in‚ 64.35546875 disk.rbd0.out‚ 0.55859375 network.sent‚ 3.61619e+06 disk.sdb1.out‚0 disk.dm-0.out‚23970.58984375 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.in‚ 253.17578125# memory_percent‚75.8152723312378) proc.memory.availableMB‚ 3962.42578125 proc.cpu.threads‚17 disk.sda2.out‚ 233.275390625 disk.md0p1.in‚ 64.35546875! proc.memory.rssMB‚ 3161.859375 network.recv‚701257) disk./.usagePercent‚83.22452686241235 disk.sdb2.in‚ 8.96484375 disk.sda2.in‚ 55.390625 disk.rbd2.in‚0T¥~ß‘Á ‚(:† ô–èԢï gpu.0.gpu‚2.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚36.0 gpu.0.powerWatts‚114.408' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.602 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0µ÷A_ ‚(:Ô ô–èÔ•Ûñ disk.sda.out‚234.70751953125) disk./.usagePercent‚83.22634094474267# disk.nvme1n1.out‚10084.59765625 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.md0.in‚ 64.35546875 disk.rbd2.in‚0$ disk./.usageGB‚2976.577079772949 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚234.70751953125 disk.sda2.in‚ 55.390625 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚24118.23046875 disk.md0p1.in‚ 64.35546875 disk.rbd0.in‚0 disk.sda.in‚ 55.390625" disk.nvme0n1.out‚ 14033.6328125) proc.memory.availableMB‚ 4038.19921875 proc.cpu.threads‚17 disk.md0p1.out‚226.25 cpu‚25.680264706735045 disk.sdb1.out‚0 disk.sda1.out‚0 network.recv‚704696 disk.rbd2.out‚ 0.55859375 disk.sdb1.in‚0! disk.sda2.out‚234.70751953125$ memory_percent‚75.35278797149658 proc.memory.rssMB‚ 3086.1875* proc.memory.percent‚18.836593627929688 disk.sda1.in‚0 network.sent‚ 3.619178e+06 disk.sdb.out‚234.70751953125 disk.md0.out‚226.25 disk.nvme0n1.in‚ 220.71875ÈÏPl2à - _wandbruntime‚2039  _runtime‚2039#lD4ÈÄ ȧ 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2462577372789383 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.15843279659748077 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.09567900747060776 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.5061342120170593 jet/accuracy_5_of_6‚0 _runtime‚2039.473189152 7"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.43790403008461 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.45956993103027344 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.004325647372752428 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.19621039927005768 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 particle/accuracy_5_of_6‚1 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 particle/accuracy_2_of_7‚1 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.4761905372142792 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6093317866325378 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6153846383094788 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9076628684997559 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.029332229867577553 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3754512071609497 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 +jet/accuracy_4_of_6‚0.07894736528396606 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.38592544198036194 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5627900958061218 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8730158805847168 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2598264217376709 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5123457312583923 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9964157938957214 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 ) Purity/1FRt1SRqqt3FBt/FRt_purity‚0.25 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.29907697439193726 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.24474206566810608 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9803318977355957 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 +jet/accuracy_3_of_3‚0.02360132895410061 *jet/accuracy_2_of_5‚0.4586639106273651 particle/accuracy_1_of_5‚1 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3689393997192383 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.4947916567325592 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9837839007377625 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9892244935035706 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.3333333432674408 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 7 P«É+èùurity/2FRt2SRqqt0FBt/FRt_purity‚0.1971937119960785 :"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.47101446986198425 & Purity/1FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5532735586166382 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9838709831237793 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.1666666716337204 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.12998677790164948 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6482247710227966 +jet/accuracy_2_of_2‚0.11184104532003403 (particle/accuracy‚0.8474408984184265 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.4166666567325592 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.18634697794914246 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04488908872008324 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4573204815387726 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.03370370343327522 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.01515151560306549 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.4000000059604645 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3782166838645935 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 particle/accuracy_4_of_6‚1 9"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.7666666507720947 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_5_of_7‚0 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.3542200028896332 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_3‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8930041790008545 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3462328612804413 ) Purity/*FRt1SRqqt3FBt/FRt_purity‚0.25 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9991833567619324 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2456192970275879 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5583560466766357 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 7 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.2606666684150696 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 6 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.529411792755127 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.20733916759490967 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.3541666567325592 particle/accuracy_3_of_7‚1 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.25538042187690735 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.08773286640644073 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_1_of_2‚0.7487304210662842 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.4166666567325592 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.44676831364631653 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.33888888359069824 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3844856321811676 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.028888888657093048 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.5187500715255737 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.14052286744117737 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.44087788462638855 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9791666269302368 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 epoch‚2 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9978495240211487 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.48538368940353394 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.014391789212822914 :"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.47527652978897095 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 jet/accuracy_7_of_7‚0 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.7857142686843872 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.0922619104385376 :"Purity/*FRt1SRqqt2FBt/event_purity‚0.04169146344065666 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5162394642829895 particle/accuracy_1_of_7‚1 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 % _timestamp‚1.7884803873568878e+09 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.4657938778400421 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_2‚1 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3974359333515167 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9803564548492432 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.4666444957256317 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.19061139225959778 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.18611110746860504 jet/accuracy_5_of_5‚0 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.46853360533714294 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.10309062898159027 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.47192543745040894 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2760084271430969 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 ;"Purity/2FRt*SRqqt1FBt/event_purity‚0.020759377628564835 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 particle/accuracy_2_of_5‚1 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ;"Purity/2FRt1SRqqt*FBt/event_purity‚0.002016128972172737 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_2_of_4‚0.3639950454235077 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 7 Purity/2FRt0SRqqt1FBt/FBt_purity‚0.9952381253242493 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.2222222238779068 +"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.25 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.34689968824386597 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 & Purity/4FRt1SRqqt0FBt/FRt_purity‚0 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.38931065797805786 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0014662756584584713 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 jet/accuracy_3_of_7‚0.5 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.38461774587631226 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.40789473056793213 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 7 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.4000000059604645 particle/accuracy_1_of_6‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9375000596046448 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.31743472814559937 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.24151650071144104 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9865338206291199 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.33736559748649597 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.25293076038360596 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.20538757741451263 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.43421053886413574 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt*SRqqt3FBt/event_purity‚0 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.5357142686843872 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 particle/accuracy_1_of_4‚1 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.28395047783851624 ("Purity/1FRt0SRqqt3FBt/event_purity‚0 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.984385073184967 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 *loss/val_total_loss‚42.676064112799715 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 8"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.512459397315979 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.4761905372142792 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 8"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.589037299156189 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 & Purity/4FRt*SRqqt0FBt/FRt_purity‚0 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.39086687564849854 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4167647063732147 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2576383054256439 :"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.44646432995796204 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ("Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 , Purity/1FRt*SRqqt3FBt/FRt_purity‚0.53125 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 *jet/accuracy_1_of_3‚0.8667272925376892 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 _step‚146 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9810135960578918 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ,jet/accuracy_4_of_5‚0.005620723590254784 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 9"Purity/*FRt1SRqqt1FBt/event_purity‚0.1145876869559288 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.20221255719661713 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 particle/accuracy_4_of_5‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9862310886383057 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.33417537808418274 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5871598124504089 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 6 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.994215726852417 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 jet/accuracy_6_of_6‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9155555963516235 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2358892410993576 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.23321814835071564 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5178571343421936 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 *jet/accuracy_2_of_6‚0.5175439119338989 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 particle/accuracy_5_of_7‚1 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9938415884971619 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/*FRt*SRqqt2FBt/event_purity‚0.1972663700580597 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.06980158388614655 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.18710878491401672 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.17270532250404358 particle/accuracy_3_of_5‚1 particle/accuracy_6_of_6‚1 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 7 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.9982078671455383 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.48788559436798096 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.46226367354393005 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.006182795390486717 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07450010627508163 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5058372020721436 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.08443073183298111 particle/accuracy_4_of_7‚1 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.20835545659065247 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3849206566810608 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9970042109489441 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 :"Purity/1FRt1SRqqt*FBt/event_purity‚0.02006610296666622 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.6611111164093018 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 & Purity/0FRt2SRqqt3FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9132937788963318 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.024567807093262672 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.21370282769203186 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9991728663444519 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5238479971885681 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 -jet/accuracy_4_of_4‚0.0048422375693917274 *jet/accuracy_1_of_5‚0.9554764032363892 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3888889253139496 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.4958028793334961 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.6359649300575256 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.3617127239704132 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4333191514015198 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 particle/accuracy_6_of_7‚1 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.15000000596046448 7 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.2089346945285797 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5272970795631409 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.3898244798183441 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6957139372825623 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5631470084190369 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 *jet/accuracy_1_of_6‚0.9736841917037964 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 6 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.989353597164154 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 jet/accuracy_2_of_7‚0.5 8"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.528911292552948 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 & Purity/1FRt2SRqqt*FBt/FBt_purity‚1 9"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.4447772800922394 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.025169556960463524 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9898749589920044 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9845001697540283 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 *jet/accuracy_1_of_4‚0.9181873202323914 +jet/accuracy_3_of_4‚0.05933215469121933 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9979424476623535 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.32592591643333435 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_2_of_3‚0.2621094882488251 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3359375 particle/accuracy_2_of_6‚1 trainer/global_step‚1811 & Purity/1FRt2SRqqt1FBt/FBt_purity‚1 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.009523899294435978 *"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.5 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.46525681018829346 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 8 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.28282541036605835 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9962489604949951 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8164684772491455 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.46853360533714294 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.22427985072135925 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.5333333611488342 9"Purity/*FRt1SRqqt0FBt/event_purity‚0.2459864765405655 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5335850119590759 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.00358422938734293 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 particle/accuracy_3_of_4‚1 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.2777778208255768 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_5_of_5‚1 6validation_average_jet_accuracy‚0.4311177730560303 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 8 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.40403443574905396 ,particle/sensitivity‚0.29343101382255554 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.3973214030265808 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 & Purity/*FRt2SRqqt3FBt/FBt_purity‚1 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.4963027834892273 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.42956990003585815 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2072802037000656 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.2711038887500763 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚0 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4454081356525421 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.19846418499946594 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4344814419746399 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.015398580580949783 +particle/specificity‚0.9499803185462952 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9870386719703674 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.18356378376483917 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.42620691657066345 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 +jet/accuracy_3_of_6‚0.21052631735801697 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 9"Purity/1FRt0SRqqt*FBt/event_purity‚0.2103462517261505 particle/accuracy_1_of_3‚1 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.40218254923820496 & Purity/*FRt2SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.3713546097278595 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9916189312934875 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 particle/accuracy_7_of_7‚0.5 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.4625000059604645 particle/accuracy_2_of_4‚1 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 particle/accuracy_2_of_3‚1 jet/accuracy_1_of_7‚1 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.4834821820259094 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.06086978316307068 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.011648745276033878 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.04285714402794838 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.4361647963523865 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.2948717772960663 & Purity/4FRt*SRqqt*FBt/FRt_purity‚0 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0011947430903092027 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2771521210670471 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.00909090880304575 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.25479069352149963 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.20497454702854156 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4807692766189575 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3515625 particle/accuracy_3_of_6‚1 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.18710878491401672 <"Purity/1FRt1SRqqt2FBt/event_purity‚0.0059523810632526875 8 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.20000000298023224 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 6 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.800000011920929 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.20824460685253143 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9991728663444519 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9929742217063904 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3260101079940796 jet/accuracy_4_of_7‚0 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.47482582926750183 )jet/accuracy_1_of_1‚0.472511351108551 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 & Purity/4FRt1SRqqt*FBt/FRt_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.6710526347160339 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3317142724990845 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1774923950433731 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.41702765226364136 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 7 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.4000000059604645 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2457275092601776 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5384959578514099 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 6 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.975185215473175 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4528461694717407 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.03846153989434242 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18682022392749786 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.5077909827232361 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5590673685073853 ("Purity/1FRt2SRqqt1FBt/event_purity‚0 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4773767590522766 7 Purity/2FRt*SRqqt1FBt/FBt_purity‚0.9981024861335754 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.2222222238779068 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 6 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.994713544845581 +jet/accuracy_3_of_5‚0.10962183028459549 jet/accuracy_6_of_7‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.5195370316505432 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.05747126787900925 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.42953330278396606 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.3114055097103119 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.44323575496673584 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.18981480598449707 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 9"Purity/1FRt*SRqqt1FBt/event_purity‚0.1649945080280304 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9927420020103455 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.4583333134651184 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 9"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.8999999761581421 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5936020612716675 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.19216929376125336 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.4838889241218567 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9868245720863342 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9993913769721985 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.24220430850982666 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.27886906266212463 'particle/f_score‚0.3752673864364624 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.039BRC44052383303642:ø0äÅ ͧ ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.44676831364631653 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.33888888359069824 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3844856321811676 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.028888888657093048 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.5187500715255737 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.14052286744117737 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.44087788462638855 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9791666269302368 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 epoch‚2 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9978495240211487 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.48538368940353394 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.014391789212822914 :"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.47527652978897095 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 jet/accuracy_7_of_7‚0 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.7857142686843872 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.0922619104385376 :"Purity/*FRt1SRqqt2FBt/event_purity‚0.04169146344065666 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5162394642829895 particle/accuracy_1_of_7‚1 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 % _timestamp‚1.7884803873568878e+09 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.4657938778400421 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_2‚1 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3974359333515167 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9803564548492432 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.4666444957256317 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.19061139225959778 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.18611110746860504 jet/accuracy_5_of_5‚0 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.46853360533714294 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.10309062898159027 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.47192543745040894 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2760084271430969 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 ;"Purity/2FRt*SRqqt1FBt/event_purity‚0.020759377628564835 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 particle/accuracy_2_of_5‚1 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ;"Purity/2FRt1SRqqt*FBt/event_purity‚0.002016128972172737 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_2_of_4‚0.3639950454235077 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 7 Purity/2FRt0SRqqt1FBt/FBt_purity‚0.9952381253242493 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.2222222238779068 +"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.25 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.34689968824386597 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 & Purity/4FRt1SRqqt0FBt/FRt_purity‚0 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.38931065797805786 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0014662756584584713 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 jet/accuracy_3_of_7‚0.5 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.38461774587631226 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.40789473056793213 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 7 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.4000000059604645 particle/accuracy_1_of_6‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9375000596046448 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.31743472814559937 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.24151650071144104 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9865338206291199 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.33736559748649597 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.25293076038360596 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.20538757741451263 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.43421053886413574 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt*SRqqt3FBt/event_purity‚0 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.5357142686843872 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 particle/accuracy_1_of_4‚1 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.28395047783851624 ("Purity/1FRt0SRqqt3FBt/event_purity‚0 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.984385073184967 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 *loss/val_total_loss‚42.676064112799715 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 8"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.512459397315979 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.4761905372142792 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 8"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.589037299156189 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 & Purity/4FRt*SRqqt0FBt/FRt_purity‚0 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.39086687564849854 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4167647063732147 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2576383054256439 :"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.44646432995796204 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ("Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 , Purity/1FRt*SRqqt3FBt/FRt_purity‚0.53125 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 *jet/accuracy_1_of_3‚0.8667272925376892 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 _step‚146 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9810135960578918 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ,jet/accuracy_4_of_5‚0.005620723590254784 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 9"Purity/*FRt1SRqqt1FBt/event_purity‚0.1145876869559288 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.20221255719661713 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 particle/accuracy_4_of_5‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9862310886383057 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.33417537808418274 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5871598124504089 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 6 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.994215726852417 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 jet/accuracy_6_of_6‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9155555963516235 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2358892410993576 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.23321814835071564 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5178571343421936 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 *jet/accuracy_2_of_6‚0.5175439119338989 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 particle/accuracy_5_of_7‚1 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9938415884971619 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/*FRt*SRqqt2FBt/event_purity‚0.1972663700580597 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.06980158388614655 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.18710878491401672 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.17270532250404358 particle/accuracy_3_of_5‚1 particle/accuracy_6_of_6‚1 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 7 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.9982078671455383 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.48788559436798096 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.46226367354393005 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.006182795390486717 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07450010627508163 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5058372020721436 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.08443073183298111 particle/accuracy_4_of_7‚1 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.20835545659065247 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3849206566810608 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9970042109489441 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 :"Purity/1FRt1SRqqt*FBt/event_purity‚0.02006610296666622 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.6611111164093018 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 & Purity/0FRt2SRqqt3FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9132937788963318 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.024567807093262672 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.21370282769203186 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9991728663444519 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5238479971885681 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 -jet/accuracy_4_of_4‚0.0048422375693917274 *jet/accuracy_1_of_5‚0.9554764032363892 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3888889253139496 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.4958028793334961 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.6359649300575256 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.3617127239704132 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4333191514015198 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 particle/accuracy_6_of_7‚1 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.15000000596046448 7 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.2089346945285797 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5272970795631409 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.3898244798183441 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6957139372825623 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5631470084190369 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 *jet/accuracy_1_of_6‚0.9736841917037964 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 6 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.989353597164154 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 jet/accuracy_2_of_7‚0.5 8"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.528911292552948 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 & Purity/1FRt2SRqqt*FBt/FBt_purity‚1 9"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.4447772800922394 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.025169556960463524 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9898749589920044 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9845001697540283 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 *jet/accuracy_1_of_4‚0.9181873202323914 +jet/accuracy_3_of_4‚0.05933215469121933 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9979424476623535 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.32592591643333435 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_2_of_3‚0.2621094882488251 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3359375 particle/accuracy_2_of_6‚1 trainer/global_step‚1811 & Purity/1FRt2SRqqt1FBt/FBt_purity‚1 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.009523899294435978 *"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.5 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.46525681018829346 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 8 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.28282541036605835 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9962489604949951 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8164684772491455 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.46853360533714294 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.22427985072135925 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.5333333611488342 9"Purity/*FRt1SRqqt0FBt/event_purity‚0.2459864765405655 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5335850119590759 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.00358422938734293 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 particle/accuracy_3_of_4‚1 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.2777778208255768 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_5_of_5‚1 6validation_average_jet_accuracy‚0.4311177730560303 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 8 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.40403443574905396 ,particle/sensitivity‚0.29343101382255554 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.3973214030265808 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 & Purity/*FRt2SRqqt3FBt/FBt_purity‚1 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.4963027834892273 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.42956990003585815 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2072802037000656 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.2711038887500763 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚0 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4454081356525421 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.19846418499946594 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4344814419746399 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.015398580580949783 +particle/specificity‚0.9499803185462952 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9870386719703674 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.18356378376483917 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.42620691657066345 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 +jet/accuracy_3_of_6‚0.21052631735801697 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 9"Purity/1FRt0SRqqt*FBt/event_purity‚0.2103462517261505 particle/accuracy_1_of_3‚1 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.40218254923820496 & Purity/*FRt2SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.3713546097278595 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9916189312934875 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 particle/accuracy_7_of_7‚0.5 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.4625000059604645 particle/accuracy_2_of_4‚1 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 particle/accuracy_2_of_3‚1 jet/accuracy_1_of_7‚1 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.4834821820259094 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.06086978316307068 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.011648745276033878 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.04285714402794838 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.4361647963523865 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.2948717772960663 & Purity/4FRt*SRqqt*FBt/FRt_purity‚0 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0011947430903092027 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2771521210670471 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.00909090880304575 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.25479069352149963 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.20497454702854156 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4807692766189575 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3515625 particle/accuracy_3_of_6‚1 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.18710878491401672 <"Purity/1FRt1SRqqt2FBt/event_purity‚0.0059523810632526875 8 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.20000000298023224 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 6 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.800000011920929 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.20824460685253143 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9991728663444519 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9929742217063904 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3260101079940796 jet/accuracy_4_of_7‚0 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.47482582926750183 )jet/accuracy_1_of_1‚0.472511351108551 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 & Purity/4FRt1SRqqt*FBt/FRt_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.6710526347160339 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3317142724990845 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1774923950433731 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.41702765226364136 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 7 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.4000000059604645 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2457275092601776 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5384959578514099 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 6 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.975185215473175 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4528461694717407 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.03846153989434242 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18682022392749786 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.5077909827232361 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5590673685073853 ("Purity/1FRt2SRqqt1FBt/event_purity‚0 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4773767590522766 7 Purity/2FRt*SRqqt1FBt/FBt_purity‚0.9981024861335754 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.2222222238779068 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 6 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.994713544845581 +jet/accuracy_3_of_5‚0.10962183028459549 jet/accuracy_6_of_7‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.5195370316505432 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.05747126787900925 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.42953330278396606 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.3114055097103119 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.44323575496673584 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.18981480598449707 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 9"Purity/1FRt*SRqqt1FBt/event_purity‚0.1649945080280304 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9927420020103455 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.4583333134651184 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 9"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.8999999761581421 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5936020612716675 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.19216929376125336 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.4838889241218567 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9868245720863342 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9993913769721985 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.24220430850982666 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.27886906266212463 'particle/f_score‚0.3752673864364624 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2462577372789383 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.15843279659748077 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.09567900747060776 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.5061342120170593 jet/accuracy_5_of_6‚0 _runtime‚2039.473189152 7"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.43790403008461 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.45956993103027344 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.004325647372752428 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.19621039927005768 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 particle/accuracy_5_of_6‚1 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 particle/accuracy_2_of_7‚1 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.4761905372142792 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6093317866325378 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6153846383094788 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9076628684997559 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.029332229867577553 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3754512071609497 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 +jet/accuracy_4_of_6‚0.07894736528396606 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.38592544198036194 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5627900958061218 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8730158805847168 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2598264217376709 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5123457312583923 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9964157938957214 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 ) Purity/1FRt1SRqqt3FBt/FRt_purity‚0.25 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.29907697439193726 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 8öÏ©yð Purity/1FRt1SRqqt*FBt/FRt_purity‚0.24474206566810608 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9803318977355957 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 +jet/accuracy_3_of_3‚0.02360132895410061 *jet/accuracy_2_of_5‚0.4586639106273651 particle/accuracy_1_of_5‚1 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3689393997192383 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.4947916567325592 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9837839007377625 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9892244935035706 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.3333333432674408 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 7 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.1971937119960785 :"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.47101446986198425 & Purity/1FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5532735586166382 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9838709831237793 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.1666666716337204 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.12998677790164948 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6482247710227966 +jet/accuracy_2_of_2‚0.11184104532003403 (particle/accuracy‚0.8474408984184265 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.4166666567325592 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.18634697794914246 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04488908872008324 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4573204815387726 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.03370370343327522 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.01515151560306549 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.4000000059604645 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3782166838645935 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 particle/accuracy_4_of_6‚1 9"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.7666666507720947 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_5_of_7‚0 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.3542200028896332 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_3‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8930041790008545 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3462328612804413 ) Purity/*FRt1SRqqt3FBt/FRt_purity‚0.25 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9991833567619324 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2456192970275879 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5583560466766357 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 7 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.2606666684150696 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 6 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.529411792755127 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.20733916759490967 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.3541666567325592 particle/accuracy_3_of_7‚1 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.25538042187690735 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.08773286640644073 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_1_of_2‚0.7487304210662842 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.4166666567325592’ _^“Æ ‚(:ˆ ƒ—èԃ裪 gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚35.0 gpu.0.powerWatts‚113.181' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.29525 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÎÎäXÇ ‚(:Í ƒ—èÔÔÆ̪ disk.sda1.out‚0 disk.dm-0.in‚ 253.17578125 proc.memory.availableMB‚4038 proc.cpu.threads‚17) disk./.usagePercent‚83.23159397594966 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.rbd0.out‚ 0.55859375 network.recv‚709296 disk.sdb1.in‚0 disk.sda2.out‚236.3857421875 disk.md0p1.out‚ 227.859375! memory_percent‚75.35400390625* proc.memory.percent‚18.836617469787598 cpu‚25.71092642201337" disk.nvme0n1.out‚ 14191.3515625 disk.nvme1n1.in‚ 32.45703125! disk.nvme1n1.out‚ 10084.703125 disk.sda1.in‚0 disk.sdb1.out‚0 disk.sda.in‚ 55.390625 disk.nvme0n1.in‚ 220.71875 disk.sdb.out‚236.3857421875 disk.sdb2.out‚236.3857421875 disk.md0.out‚ 227.859375# proc.memory.rssMB‚ 3086.19140625% disk./.usageGB‚2976.7649536132812 disk.sda2.in‚ 55.390625 disk.md0p1.in‚ 64.35546875 disk.rbd2.out‚ 0.55859375 network.sent‚ 3.625618e+06 disk.sda.out‚236.3857421875 disk.md0.in‚ 64.35546875 disk.rbd0.in‚0 disk.dm-0.out‚ 24276.0546875 disk.rbd2.in‚0ÐÆñÚnÈ ‚(:ã ’—èÔÀø¼« disk.nvme0n1.in‚ 220.71875 disk.rbd0.out‚ 0.55859375 disk.dm-0.out‚25100.62890625 disk.sdb1.in‚0 disk.rbd2.out‚ 0.55859375% disk./.usageGB‚2977.5690841674805! disk.sdb2.out‚238.27587890625 disk.md0p1.out‚ 229.67578125 disk.rbd0.in‚0$ memory_percent‚78.80117893218994) proc.memory.availableMB‚ 3473.21484375 cpu‚25.704489905754503# disk.nvme1n1.out‚10084.89453125 network.sent‚ 3.72696e+06) disk./.usagePercent‚83.25407780279987 disk.md0.out‚ 229.67578125 disk.rbd2.in‚0 proc.cpu.threads‚17 disk.md0.in‚ 64.35546875 disk.dm-0.in‚ 253.17578125 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625! disk.sda2.out‚238.27587890625 disk.md0p1.in‚ 64.35546875# proc.memory.rssMB‚ 3085.19140625 disk.sdb.out‚238.27587890625 network.recv‚713830 disk.sda1.out‚0! disk.nvme0n1.out‚ 15015.734375 disk.nvme1n1.in‚ 32.45703125 disk.sdb1.out‚0* proc.memory.percent‚18.830513954162598 disk.sda.in‚ 55.390625 disk.sda.out‚238.27587890625 disk.sdb2.in‚ 8.96484375 disk.sda1.in‚0‡Esš”É ‚(:‰ ’—èÔúãÁ« gpu.0.gpu‚60.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚216.846' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.2115 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‰o§“Ê ‚(:ˆ ¡—èÔ½Ëõ« gpu.0.gpu‚27.0 gpu.0.memory‚7, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚116.306' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.0765 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0@´–aË ‚(:Ö ¡—èÔ¥¢„­ disk.nvme0n1.in‚ 220.71875# disk.nvme0n1.out‚15862.98046875* proc.memory.percent‚18.830513954162598 disk.sda.in‚ 55.390625 disk.sda.out‚239.8798828125$ memory_percent‚78.79974842071533 cpu‚25.703824989201305 proc.cpu.threads‚17 disk.sdb.out‚239.8798828125 disk.sdb2.in‚ 8.96484375 disk.dm-0.out‚25948.10546875 disk.sdb1.out‚0# proc.memory.rssMB‚ 3085.19140625) proc.memory.availableMB‚ 3473.44921875$ disk./.usageGB‚2977.565902709961 disk.dm-0.in‚ 253.17578125 disk.rbd2.out‚ 0.55859375 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.out‚239.8798828125 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 disk.md0.out‚ 231.21875 disk.rbd2.in‚0 disk.sda1.in‚0) disk./.usagePercent‚83.25398884791608 disk.sda2.out‚239.8798828125 disk.nvme1n1.out‚ 10085.125 network.sent‚ 3.733656e+06 disk.sdb.in‚ 8.96484375 disk.md0p1.out‚ 231.21875 disk.rbd0.in‚0 disk.rbd0.out‚ 0.55859375 disk.sda1.out‚0 network.recv‚718695 disk.md0p1.in‚ 64.35546875 disk.sdb1.in‚0cK%¢2Ì - _wandbruntime‚2084  _runtime‚2084¥ý‹iÇÍ Á _step‚147 & lr-AdamW/pg1‚0.0010479705833093295 & lr-AdamW/pg2‚0.0010479705833093295 trainer/global_step‚1849 % _timestamp‚1.7884804326544616e+09 _runtime‚2084.764733147VýÌÎ Æ % _timestamp‚1.7884804326544616e+09 _runtime‚2084.764733147 _step‚147 & lr-AdamW/pg1‚0.0010479705833093295 & lr-AdamW/pg2‚0.0010479705833093295 trainer/global_step‚1849“<¼è2Ï - _wandbruntime‚2084  _runtime‚2084ù}_ë'Ð åO IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚256115298950656 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2033264275968 trainer/global_step‚1849 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2204206690304 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚74582203 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2033264275968 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚20873289 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2204364834816 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚249741764011440 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚41024781 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2025662326060 _step‚148 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2032480799232 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚251767426337500 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚33534150 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚220482468312064 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚33534148 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚256116099466752 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚256116099466752 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚254082835190784 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚518 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚254082818151424 % _timestamp‚1.7884804326552114e+09 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚251768224858744 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚41024781 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚33534150 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 _runtime‚ 2084.76556924Ýdýßð'Ñ êO H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2204206690304 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚74582203 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2033264275968 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚20873289 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2204364834816 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚249741764011440 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚41024781 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2025662326060 _step‚148 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2032480799232 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚251767426337500 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚33534150 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚220482468312064 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚33534148 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚256116099466752 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚256116099466752 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚254082835190784 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚518 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚254082818151424 % _timestamp‚1.7884804326552114e+09 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚251768224858744 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚41024781 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚33534150 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 _runtime‚ 2084.76556924 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚256115298950656 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2033264275968 trainer/global_step‚1849”$¢F“Ò ‚(:ˆ °—èÔØ´Ý« gpu.0.gpu‚5.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚226.703' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.67575 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ådÕ`Ó ‚(:Õ °—èÔ”Ꙭ disk.sda1.out‚0! disk.nvme1n1.out‚ 10085.328125 disk.sdb.out‚ 241.388671875 disk.dm-0.out‚26183.11328125 disk.rbd2.out‚ 0.55859375 disk.nvme0n1.in‚ 220.71875 disk.rbd0.out‚ 0.55859375 disk.sda.out‚ 241.388671875 disk.rbd0.in‚0* proc.memory.percent‚18.830513954162598 disk.md0p1.in‚ 64.35546875% disk./.usageGB‚2977.5659561157227 disk.sda2.in‚ 55.390625 disk.sda2.out‚ 241.388671875 disk.md0.in‚ 64.35546875) disk./.usagePercent‚83.25399034116352 disk.sdb1.in‚0 disk.sdb2.out‚ 241.388671875 disk.md0p1.out‚ 232.671875 disk.rbd2.in‚0' proc.memory.availableMB‚ 3473.203125 network.sent‚ 3.73889e+06$ memory_percent‚78.80125045776367 cpu‚25.703583103578264 network.recv‚722617 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚ 8.96484375 disk.md0.out‚ 232.671875 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0 disk.sda.in‚ 55.390625# disk.nvme0n1.out‚16097.78515625 disk.sdb.in‚ 8.96484375# proc.memory.rssMB‚ 3085.19140625 proc.cpu.threads‚17Ðñ‰2Ô - _wandbruntime‚2085  _runtime‚2085ÙF|ïÁÕ ðM YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2034330628096 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2205516644864 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2205360610816 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 RDDeviceStatsMonãxÉ©5%itor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚33551600 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚220597582987264 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚251899139283866 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚30539047 PDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 trainer/global_step‚1849 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚33551602 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚9655001 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚218392222376448 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚251899937805318 % _timestamp‚1.7884804335071194e+09 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚74621369 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚74598069 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚218392247280128 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚41046469 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚254215569463296 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚33551602 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2033547138048 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 _runtime‚2085.617877582 _step‚149 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2033547138048 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚30539559 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚74621369 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚256249917130752 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚9655510 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚254215586502656 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2034330628096 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚20884049 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚249872431251840 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚249872414212480 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2027506553478 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2026725071386 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚220597763924992 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚41069767 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚30539047 PDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 trainer/global_step‚1849 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚33551602 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚9655001 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚218392222376448 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚251899937805318 % _timestamp‚1.7884804335071194e+09 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚74621369 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚74598069 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚218392247280128 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚41046469 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚254215569463296 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚33551602 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2033547138048 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 _runtime‚2085.617877582 _step‚149 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2033547138048 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚30539559 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚74621369 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚256249917130752 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚9655510 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚254215586502656 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2034330628096 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚20884049 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚249872431251840 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚249872414212480 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2027506553478 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2026725071386 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚220597763924992 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚41069767 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 BŸÞ ‚(:” Ý—èÔŸø‰« gpu.0.gpu‚81.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚231.761' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚57.940250000000006 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0•Ø‡Ü]ß ‚(:Ò Ý—èÔ»ÄÈ« disk.rbd0.out‚ 0.55859375 disk.sdb.out‚246.8212890625 disk.nvme0n1.in‚ 220.71875 disk.sdb.in‚ 8.96484375# proc.memory.rssMB‚ 3085.19140625 proc.cpu.threads‚17$ disk./.usageGB‚2976.026321411133 disk.md0p1.out‚ 237.890625 disk.sda.out‚246.8212890625* proc.memory.percent‚18.830513954162598 disk.md0.out‚ 237.890625 disk.md0p1.in‚ 64.35546875 disk.nvme1n1.out‚ 10086.40625 disk.sda2.in‚ 55.390625 disk.dm-0.out‚26471.51953125 disk.nvme1n1.in‚ 32.45703125 disk.sda2.out‚246.8212890625 cpu‚25.700985908735323 disk.rbd2.out‚ 0.55859375 disk.md0.in‚ 64.35546875 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125 disk.sdb2.in‚ 8.96484375" proc.memory.availableMB‚3472.5 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb2.out‚246.8212890625# memory_percent‚78.8055419921875 disk.rbd2.in‚0 network.sent‚ 3.899013e+06 network.recv‚737719) disk./.usagePercent‚83.21094151043602 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda.in‚ 55.390625# disk.nvme0n1.out‚16385.11328125ÐAím2à - _wandbruntime‚2133  _runtime‚2133?U8Çá Á _runtime‚2133.175155491 _step‚151 & lr-AdamW/pg1‚0.0010363943924626572 & lr-AdamW/pg2‚0.0010363943924626572 trainer/global_step‚1899 % _timestamp‚1.7884804810648756e+09á÷F«Ìâ Æ & lr-AdamW/pg2‚0.0010363943924626572 trainer/global_step‚1899 % _timestamp‚1.7884804810648756e+09 _runtime‚2133.175155491 _step‚151 & lr-AdamW/pg1‚0.0010363943924626572—¤6t'2ã - _wandbruntime‚2133  _runtime‚2133 4Û“‘ä æO ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2079608246252 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚76519281 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚42112533 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚31308856 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚34406750 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚262807009829376 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚223985293621248 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚34406748 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚42112533 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚262806209313280 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚21411286 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚260720383745024 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2078826764368 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚223985268717568 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚34406750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚226247524703232 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚258353899349052 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚42135805 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2086609044992 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2085825568256 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 SGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚9897570 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚256274274063440 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚21411289 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚226247347946496 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚256274291102800 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 trainer/global_step‚1899 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚260720383745024 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚31309386 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚34406748 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚21411289 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚226247347946496 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚256274291102800 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 trainer/global_step‚1899 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚260720383745024 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚31309386 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚34406748 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2079608246252 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚76519281 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚42112533 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚31308856 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚34406750 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚262807009829376 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚223985293621248 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚34406748 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚42112533 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚262806209313280 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚21411286 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚260720383745024 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2078826764368 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚223985268717568 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚34406750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚226247524703232 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚258353899349052 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0˜œÿ‡2æ - _wandbruntime‚2134  _runtime‚2134òÀƒwõ&ç ïM WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚260853135056896 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚31324596 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189326336 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚224099437424128 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2086891907072 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 $ _timestamp‚1.788480481922226e+09 _step‚153 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚260853135056896 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚260853152096256 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2086891907072 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚31325108 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚21422046 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2263382089216 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚256404924264480 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2087675397120 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚226362630187008 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚256404941303840 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚76558421 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚9902550 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚76581721 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚76581721 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚9903059 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚42157519 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 164422656 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚224099412520448 trainer/global_step‚1899 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚34424200 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2087675397120 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _runtime‚2134.033089599 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚34424202 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚21422049 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚34424202 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚76558421 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚31324596 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189326336 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚224099437424128 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2086891907072 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 $ _timestamp‚1.788480481922226e+09 _step‚153 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚260853135056896 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚260853152096256 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2086891907072 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚31325108 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚21422046 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2263382089216 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚256404924264480 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2087675397120 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚226362630187008 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚256404941303840 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚76558421 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 QEDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚9902550 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚76581721 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚76581721 UIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚9903059 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚42157519 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 164422656 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚224099412520448 trainer/global_step‚1899 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚34424200 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2087675397120 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _runtime‚2134.033089599 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚34424202 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚21422049 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚34424202™í0r<2é - _wandbruntime‚2134  _runtime‚2134P½ÜZê Ô /loss/FBt3/detection_loss‚2.7736166678369045 epoch‚3 _runtime‚2134.034597766 /loss/FRt1/assignment_loss‚1.300675036366453 0loss/FRt3/assignment_loss‚3.1891764114642966 2loss/SRqqt3/assignment_loss‚2.0150701141562957 1loss/SRqqt4/detection_loss‚2.3370512472144487 .loss/FBt4/detection_loss‚2.763083456084132 2loss/SRqqt2/assignment_loss‚1.7143681627072271 1loss/SRqqt2/detection_loss‚1.5123447492474416 1loss/FBt2/assignment_loss‚0.12075451644074064 .loss/FRt2/detection_loss‚2.377844916371738 % _timestamp‚1.7884804819245765e+09 /loss/FRt4/assignment_loss‚3.205110580614298 1loss/SRqqt4/assignment_loss‚1.776525517861391 1loss/FBt1/assignment_loss‚0.14000472382486068 .loss/FRt1/detection_loss‚1.602339478036792 /loss/FRt3/detection_loss‚2.9336662040702226 /loss/FBt2/detection_loss‚2.6616211887449026 &loss/total_loss‚43.012390150737694 trainer/global_step‚1899 2loss/SRqqt1/assignment_loss‚0.8686851110386973 0loss/FBt3/assignment_loss‚0.3175687044786457 /loss/FRt2/assignment_loss‚3.041189456687254 /loss/FRt4/detection_loss‚2.2551231469156794 0loss/SRqqt1/detection_loss‚1.078438908420503 1loss/SRqqt3/detection_loss‚2.3805722609676163 /loss/FBt1/detection_loss‚0.5665373355601773 _step‚154 0loss/FBt4/assignment_loss‚0.0810222556269764ošŒð_ë Ù /loss/FRt1/assignment_loss‚1.300675036366453 0loss/FRt3/assignment_loss‚3.1891764114642966 2loss/SRqqt3/assignment_loss‚2.0150701141562957 1loss/SRqqt4/detection_loss‚2.3370512472144487 .loss/FBt4/detection_loss‚2.763083456084132 2loss/SRqqt2/assignment_loss‚1.7143681627072271 1loss/SRqqt2/detection_loss‚1.5123447492474416 1loss/FBt2/assignment_loss‚0.12075451644074064 .loss/FRt2/detection_loss‚2.377844916371738 % _timestamp‚1.7884804819245765e+09 /loss/FRt4/assignment_loss‚3.205110580614298 1loss/SRqqt4/assignment_loss‚1.776525517861391 1loss/FBt1/assignment_loss‚0.14000472382486068 .loss/FRt1/detection_loss‚1.602339478036792 /loss/FRt3/detection_loss‚2.9336662040702226 /loss/FBt2/detection_loss‚2.6616211887449026 &loss/total_loss‚43.012390150737694 trainer/global_step‚1899 2loss/SRqqt1/assignment_loss‚0.8686851110386973 0loss/FBt3/assignment_loss‚0.3175687044786457 /loss/FRt2/assignment_loss‚3.041189456687254 /loss/FRt4/detection_loss‚2.2551231469156794 0loss/SRqqt1/detection_loss‚1.078438908420503 1loss/SRqqt3/detection_loss‚2.3805722609676163 /loss/FBt1/detection_loss‚0.5665373355601773 _step‚154 0loss/FBt4/assignment_loss‚0.0810222556269764 /loss/FBt3/detection_loss‚2.7736166678369045 epoch‚3 _runtime‚2134.034597766šTÓ¨cì ‚(:Ø ì—èÔñÅŸ« disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125" disk.nvme0n1.out‚ 16386.7734375 disk.sdb.in‚ 8.96484375 disk.sdb2.out‚248.4775390625 proc.cpu.threads‚17 network.sent‚ 3.901935e+06 disk.rbd2.out‚ 0.55859375 disk.sda1.out‚0 network.recv‚741219( disk./.usagePercent‚83.2068253738409 disk.md0p1.out‚ 239.484375 disk.rbd0.out‚ 0.55859375 disk.dm-0.out‚ 26550.453125" disk.nvme1n1.out‚ 10163.6796875 disk.sdb2.in‚ 8.96484375$ memory_percent‚78.80747318267822 disk.sda.out‚248.4775390625 disk.nvme1n1.in‚ 32.45703125 cpu‚25.699496706455715$ disk./.usageGB‚2975.879108428955 disk.md0.out‚ 239.484375 disk.sdb1.out‚0 disk.sda.in‚ 55.390625 disk.sdb.out‚248.4775390625* proc.memory.percent‚18.830513954162598 disk.sda2.out‚248.4775390625 disk.md0.in‚ 64.35546875) proc.memory.availableMB‚ 3472.18359375# proc.memory.rssMB‚ 3085.19140625 disk.sda2.in‚ 55.390625 disk.md0p1.in‚ 64.35546875 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875ø4o”í ‚(:‰ ì—èÔ»ÕÖ« gpu.0.gpu‚43.0 gpu.0.memory‚7, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚201.859' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚50.46475 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0CSDºŸî ‚(:” û—èÔ¬¡Í© gpu.0.gpu‚73.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚225.753' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚56.438250000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0þªÛýkï ‚(:à û—èÔñ‹Ûª disk.sdb1.in‚0# disk.nvme1n1.out‚10195.10546875 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625! disk.sda2.out‚250.48486328125 disk.rbd2.out‚ 0.55859375! disk.sdb2.out‚250.48486328125% proc.memory.availableMB‚ 3471.9375* proc.memory.percent‚18.830513954162598 cpu‚25.698261316101398 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚250.48486328125 disk.md0.out‚ 241.41796875 network.recv‚746882 disk.sda.in‚ 55.390625 disk.sda1.in‚0 disk.sdb2.in‚ 8.96484375# proc.memory.rssMB‚ 3085.19140625 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 241.41796875 disk.rbd0.in‚0 disk.rbd0.out‚ 0.55859375 disk.dm-0.out‚26582.08203125$ memory_percent‚78.80897521972656 network.sent‚ 3.991001e+06$ disk./.usageGB‚2976.004463195801 disk.dm-0.in‚ 253.17578125) disk./.usagePercent‚83.21033034558695 disk.nvme0n1.in‚ 220.71875" disk.nvme0n1.out‚ 16386.9765625 disk.md0p1.in‚ 64.35546875 disk.sdb1.out‚0 disk.sda.out‚250.48486328125 disk.rbd2.in‚0 proc.cpu.threads‚17‡ü¼’ð ‚(:‡ Š˜èԛݩ gpu.0.gpu‚53.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚207.484' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.871 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0É iñ ‚(:Þ Š˜èÔµ¶ëª disk.rbd0.in‚0 network.sent‚ 3.993923e+06 disk.sda.in‚ 55.390625 disk.sda1.in‚0 disk.sdb.in‚ 8.96484375# proc.memory.rssMB‚ 3085.19140625 disk.sdb2.in‚ 8.96484375 disk.sda2.out‚252.1865234375$ memory_percent‚78.80752086639404* proc.memory.percent‚18.830513954162598 cpu‚25.696800308160277 disk.sda.out‚252.1865234375 disk.nvme0n1.in‚ 220.71875 disk.sda2.in‚ 55.390625 disk.rbd0.out‚ 0.55859375 disk.sdb2.out‚252.1865234375 disk.md0p1.out‚ 243.05078125 disk.rbd2.out‚ 0.55859375 disk.sdb1.in‚0) proc.memory.availableMB‚ 3472.17578125 proc.cpu.threads‚17) disk./.usagePercent‚83.21883982950015 disk.sda1.out‚0# disk.nvme1n1.out‚10397.99609375 disk.md0.in‚ 64.35546875 disk.md0.out‚ 243.05078125 disk.md0p1.in‚ 64.35546875 network.recv‚750503% disk./.usageGB‚2976.3088035583496# disk.nvme0n1.out‚16387.31640625 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚252.1865234375 disk.sdb1.out‚0 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 26785.3125 disk.rbd2.in‚0¤¤«ò2ò - _wandbruntime‚2184  _runtime‚2184¸i1»Çó Á _step‚155 & lr-AdamW/pg1‚0.0010244522675792078 & lr-AdamW/pg2‚0.0010244522675792078 trainer/global_step‚1949 % _timestamp‚1.7884805319581108e+09 _runtime‚2184.068403364l]BÌô Æ trainer/global_step‚1949 % _timestamp‚1.7884805319581108e+09 _runtime‚2184.068403364 _step‚155 & lr-AdamW/pg1‚0.0010244522675792078 & lr-AdamW/pg2‚0.0010244522675792078›_eÁè2õ - _wandbruntime‚2184  _runtime‚2184DÙ™í'ö çO PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚43223557 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚32095817 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚35279348 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚78502907 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚21949289 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚269497119675904 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 trainer/global_step‚1949 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2132772684560 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚267357949338624 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2139953814016 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚267357966377984 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚21949286 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚262806784115440 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚43200285 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚43200285 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚264939573839360 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2131991202676 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 $ _timestamp‚1.788480531958968e+09 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚232012515157504 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2319881636352 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚229692483765248 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚267357966377984 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2139170337280 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2139953814016 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚10146528 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚35279348 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚32095311 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2320031392256 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚2184.069337549 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚267357949338624 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _step‚156 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2139170337280 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚35279350 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚10146025 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚269497119675904 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚269497119675904 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 trainer/global_step‚1949 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2132772684560 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚267357949338624 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2139953814016 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚267357966377984 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚21949286 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚262806784115440 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚43200285 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚43200285 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚264939573839360 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2131991202676 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 $ _timestamp‚1.788480531958968e+09 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚232012515157504 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2319881636352 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚229692483765248 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚267357966377984 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2139170337280 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2139953814016 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚10146528 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚35279348 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚32095311 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2320031392256 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚2184.069337549 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚267357949338624 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _step‚156 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2139170337280 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚35279350 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚10146025 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚269497119675904 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 IDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2140236676096 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚267490700650496 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚78542073 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚10151423 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚501 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚267490717689856 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚78518773 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚10150922 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2321028145664 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚232127815942144 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚269631737856000 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185132032 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2321188374016 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2140236676096 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚265070488264482 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚43245271 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚35296802 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚232127630810112 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚32110968 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2133053948002 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚78518773 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚35296802 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚265071286785934 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚43221973 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚265070488264482 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚43245271 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚35296802 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚232127630810112 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚32110968 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2133053948002 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚78518773 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚35296802 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚265071286785934 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚43221973 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2140236676096 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚267490700650496 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚78542073 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚10151423 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚501 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚267490717689856 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360©æÜ2û - _wandbruntime‚2184  _runtime‚2184…Ï3V^ü Ø epoch‚3 _step‚158 /loss/FRt3/detection_loss‚2.7069677356878916 0loss/SRqqt3/detection_loss‚2.230567235977222 /loss/FRt2/detection_loss‚2.3351939442171448 2loss/SRqqt2/assignment_loss‚1.6702417735941708 2loss/SRqqt4/assignment_loss‚1.4774637587368489 1loss/FBt2/assignment_loss‚0.05955125863277187 0loss/FRt2/assignment_loss‚2.1750899388872345 0loss/FRt3/assignment_loss‚3.3406096386909483 2loss/SRqqt1/assignment_loss‚1.0778937031060827 /loss/FRt1/detection_loss‚1.6812818391127107 /loss/FBt1/detection_loss‚0.6958529106651743 .loss/FRt4/assignment_loss‚3.07547834983059 2loss/SRqqt3/assignment_loss‚1.6008449739848192 1loss/FBt3/assignment_loss‚0.18763755880585944 1loss/FBt4/assignment_loss‚0.33950244014964814 1loss/SRqqt1/detection_loss‚1.0982959114846365 /loss/FBt3/detection_loss‚3.4355193593285303 trainer/global_step‚1949 0loss/FRt1/assignment_loss‚1.7091273937536322 /loss/FRt4/detection_loss‚2.0298181521807863 1loss/SRqqt4/detection_loss‚2.2948717406817845 $ _timestamp‚1.788480532815603e+09 _runtime‚2184.925692115 1loss/FBt1/assignment_loss‚0.15356202205046984 1loss/SRqqt2/detection_loss‚1.5235255383435757 /loss/FBt2/detection_loss‚2.0977546455604688 .loss/FBt4/detection_loss‚2.757753458890048 %loss/total_loss‚41.75440528235305øFW^cý Ý 0loss/FRt2/assignment_loss‚2.1750899388872345 0loss/FRt3/assignment_loss‚3.3406096386909483 2loss/SRqqt1/assignment_loss‚1.0778937031060827 /loss/FRt1/detection_loss‚1.6812818391127107 /loss/FBt1/detection_loss‚0.6958529106651743 .loss/FRt4/assignment_loss‚3.07547834983059 2loss/SRqqt3/assignment_loss‚1.6008449739848192 1loss/FBt3/assignment_loss‚0.18763755880585944 1loss/FBt4/assignment_loss‚0.33950244014964814 1loss/SRqqt1/detection_loss‚1.0982959114846365 /loss/FBt3/detection_loss‚3.4355193593285303 trainer/global_step‚1949 0loss/FRt1/assignment_loss‚1.7091273937536322 /loss/FRt4/detection_loss‚2.0298181521807863 1loss/SRqqt4/detection_loss‚2.2948717406817845 $ _timestamp‚1.788480532815603e+09 _runtime‚2184.925692115 1loss/FBt1/assignment_loss‚0.15356202205046984 1loss/SRqqt2/detection_loss‚1.5235255383435757 /loss/FBt2/detection_loss‚2.0977546455604688 .loss/FBt4/detection_loss‚2.757753458890048 %loss/total_loss‚41.75440528235305 epoch‚3 _step‚158 /loss/FRt3/detection_loss‚2.7069677356878916 0loss/SRqqt3/detection_loss‚2.230567235977222 /loss/FRt2/detection_loss‚2.3351939442171448 2loss/SRqqt2/assignment_loss‚1.6702417735941708 2loss/SRqqt4/assignment_loss‚1.4774637587368489 1loss/FBt2/assignment_loss‚0.05955125863277187žè™W$”þ ‚(:‰ ™˜èÔÙØÉ« gpu.0.gpu‚40.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.966' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.9915 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ä jdÿ ‚(:Ù ™˜èÔ– œ¬ network.recv‚755537 disk.sdb1.out‚0 disk.sda.in‚ 55.390625 disk.sdb.in‚ 8.96484375 disk.sdb.out‚254.0517578125 disk.sda2.in‚ 55.390625 disk.md0.out‚ 244.859375* proc.memory.percent‚18.830513954162598) disk./.usagePercent‚83.22590395654258 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda2.out‚254.0517578125 network.sent‚ 4.000759e+06 disk.dm-0.out‚26941.55859375 disk.nvme0n1.in‚ 220.71875$ memory_percent‚78.80847454071045 proc.cpu.threads‚17 disk.rbd0.out‚ 0.55859375 disk.sda1.out‚0# disk.nvme0n1.out‚16387.37109375# proc.memory.rssMB‚ 3085.19140625 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.out‚254.0517578125) proc.memory.availableMB‚ 3472.01953125$ disk./.usageGB‚2976.561450958252 disk.sda1.in‚0 disk.md0.in‚ 64.35546875 disk.dm-0.in‚ 253.17578125 disk.sda.out‚254.0517578125 disk.nvme1n1.out‚ 10554.1875 disk.sdb2.in‚ 8.96484375 cpu‚25.695216848184437 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 244.859375 disk.rbd0.in‚0 disk.rbd2.out‚ 0.55859375°@•€‚(:Š ¨˜èÔçú¹« gpu.0.gpu‚73.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚228.261' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.06525 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0šxYm‚(:â ¨˜èÔùüÏ«# disk.nvme0n1.out‚16387.55078125 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 246.26171875 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.17578125 disk.md0p1.in‚ 64.35546875 disk.sdb.in‚ 8.96484375) disk./.usagePercent‚83.22603728220773 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚ 8.96484375 disk.dm-0.out‚27063.44140625 disk.sdb1.in‚0* proc.memory.percent‚18.830513954162598 cpu‚25.69370307314448 network.sent‚ 4.086468e+06 disk.sda.in‚ 55.390625 disk.sda1.in‚0! disk.sdb2.out‚255.52685546875) proc.memory.availableMB‚ 3472.12890625 disk.rbd2.in‚0 disk.md0.out‚ 246.26171875 proc.cpu.threads‚17! disk.nvme1n1.out‚ 10675.890625$ disk./.usageGB‚2976.566219329834! disk.sda2.out‚255.52685546875$ memory_percent‚78.80780696868896 network.recv‚759955# proc.memory.rssMB‚ 3085.19140625 disk.sdb.out‚255.52685546875 disk.sda.out‚255.52685546875 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.rbd2.out‚ 0.55859375 disk.nvme0n1.in‚ 220.71875\5‚‚(:’ ·˜èÔœáæ© gpu.0.gpu‚36.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚224.527' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚56.13174999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ɾðÂ^ƒ‚(:Ó ·˜èÔ¬ô™« disk.md0p1.in‚ 64.35546875 disk.rbd0.in‚0 disk.dm-0.out‚27207.91015625 disk.sda1.in‚0 disk.nvme1n1.out‚ 10820.3125% disk./.usageGB‚2976.5662231445312 disk.md0p1.out‚ 248.26953125 disk.rbd0.out‚ 0.55859375 disk.rbd2.in‚0 disk.rbd2.out‚ 0.55859375 disk.sda.out‚ 257.59765625 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚ 8.96484375 cpu‚25.69242371848629 network.recv‚763807# disk.nvme0n1.out‚16387.59765625( proc.memory.availableMB‚ 3471.8828125# proc.memory.rssMB‚ 3085.19140625* proc.memory.percent‚18.830513954162598) disk./.usagePercent‚83.22603738886826 disk.sda2.in‚ 55.390625 disk.dm-0.in‚ 253.17578125 disk.sdb1.in‚0 disk.sdb1.out‚0 proc.cpu.threads‚17 disk.md0.out‚ 248.26953125 disk.sdb.out‚ 257.59765625 disk.sdb2.out‚ 257.59765625 disk.sda2.out‚ 257.59765625 disk.md0.in‚ 64.35546875 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.sdb.in‚ 8.96484375# memory_percent‚78.8093090057373 network.sent‚ 4.091888e+06 disk.sda.in‚ 55.390625®¥2„- _wandbruntime‚2233  _runtime‚2233àœ&ÀÇ…Á & lr-AdamW/pg1‚0.0010121541795104529 & lr-AdamW/pg2‚0.0010121541795104529 trainer/global_step‚1999 % _timestamp‚1.7884805817615335e+09 _runtime‚2233.871919024 _step‚159ÜDUlÌ†Æ _runtime‚2233.871919024 _step‚159 & lr-AdamW/pg1‚0.0010121541795104529 & lr-AdamW/pg2‚0.0010121541795104529 trainer/global_step‚1999 % _timestamp‚1.7884805817615335e+09ŸÚc ï2‡- _wandbruntime‚2233  _runtime‚22335qº‘¿ˆçO ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚44288037 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚44311309 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2193298583040 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2192515106304 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚36151950 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚10395655 _step‚160 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚22487289 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚237777555747328 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚269339311206800 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚273995514932224 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚80463259 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚32882944 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2192515106304 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚22487286 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚235399649005568 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2185937122868 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚276188030038528 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2377881838080 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚531 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚237777376893440 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚271524449808424 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 trainer/global_step‚1999 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_poolÿ{‚P..allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚276188030038528 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚276188830554624 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚80439985 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚36151948 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚10395124 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚2233.874769948 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2185155640984 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚273995531971584 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚273995531971584 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2193298583040 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚276188830554624 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208ì¬Ùäò'‰ìO LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚80439985 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚36151948 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚10395124 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚2233.874769948 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2185155640984 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚273995531971584 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚273995531971584 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2193298583040 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚276188830554624 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚44288037 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚44311309 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2193298583040 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2192515106304 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚36151950 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚10395655 _step‚160 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚22487289 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚237777555747328 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚269339311206800 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚273995514932224 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚80463259 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚32882944 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2192515106304 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚22487286 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚235399649005568 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2185937122868 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚276188030038528 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2377881838080 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚531 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚237777376893440 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚271524449808424 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 trainer/global_step‚1999 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚276188030038528 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚276188830554624 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 h¤eî2Š- _wandbruntime‚2234  _runtime‚2234&ï9ø&‹òM GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2186999868402 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚36169400 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚44309725 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚276322648218624 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚510 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚237892674520576 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2186218386310 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚10400606 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚32898142 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚271656162754790 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 _step‚161 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2194364935168 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2193581445120 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2194364935168 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚80479125 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚269469961407840 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚36169402 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚271656961276242 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚44309725 trainer/global_step‚1999 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚274128283283456 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚10400096 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚80502425 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚237892855458304 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚44333023 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2378881712128 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚36169402 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚36169400 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚44333023 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚80502425 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚22498046 _runtime‚2234.828907455 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚80479125 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚274128283283456 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚274128266244096 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚513 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚235513792808448 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 % _timestamp‚1.7884805827180037e+09 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400ç®Àö“"Œ÷M \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚237892855458304 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚44333023 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2378881712128 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚36169402 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚36169400 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚44333023 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚80502425 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚22498046 _runtime‚2234.828907455 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚80479125 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚274128283283456 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚274128266244096 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚513 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚235513792808448 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 % _timestamp‚1.7884805827180037e+09 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2186999868402 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚36169400 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚44309725 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚276322648218624 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚510 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚237892674520576 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2186218386310 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚10400606 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚32898142 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚271656162754790 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 _step‚161 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2194364935168 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2193581445120 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2194364935168 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚80479125 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚269469961407840 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚36169402 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚271656961276242 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚44309725 trainer/global_step‚1999 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚274128283283456 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freedkZ<j‚10400096 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚80502425¡“eô2- _wandbruntime‚2234  _runtime‚2234:àcœXŽÒ 0loss/SRqqt3/detection_loss‚2.345991426188013 _runtime‚2234.829952359 /loss/FBt3/detection_loss‚2.7926050782203675 .loss/FBt4/detection_loss‚2.429759101735221 1loss/SRqqt2/assignment_loss‚1.360895183444794 .loss/FRt2/detection_loss‚2.256246998425453 .loss/FRt4/detection_loss‚2.317205819453332 /loss/FRt1/detection_loss‚1.5485145906076847 0loss/SRqqt4/detection_loss‚2.237404977929765 %loss/total_loss‚40.70127757672505 _step‚162 2loss/FBt2/assignment_loss‚0.059053963463302356 /loss/FRt3/detection_loss‚2.9989350229501723 /loss/FBt2/detection_loss‚2.0035310888290407 .loss/FRt3/assignment_loss‚3.72106853723526 1loss/SRqqt3/assignment_loss‚1.973570343295949 1loss/FBt1/assignment_loss‚0.06944321234132725 % _timestamp‚1.7884805827198663e+09 epoch‚3 trainer/global_step‚1999 /loss/FRt2/assignment_loss‚2.148861745993296 /loss/FRt4/assignment_loss‚3.021100500751944 1loss/SRqqt1/assignment_loss‚0.832772012496535 1loss/SRqqt1/detection_loss‚0.9719466603376338 1loss/SRqqt2/detection_loss‚1.4692201760308496 0loss/FRt1/assignment_loss‚1.3029791076206467 2loss/SRqqt4/assignment_loss‚1.7573333564281897 1loss/FBt4/assignment_loss‚0.20881035269295958 /loss/FBt1/detection_loss‚0.6748635078429016 1loss/FBt3/assignment_loss‚0.19916481241040554¼÷§µ]× epoch‚3 trainer/global_step‚1999 /loss/FRt2/assignment_loss‚2.148861745993296 /loss/FRt4/assignment_loss‚3.021100500751944 1loss/SRqqt1/assignment_loss‚0.832772012496535 1loss/SRqqt1/detection_loss‚0.9719466603376338 1loss/SRqqt2/detection_loss‚1.4692201760308496 0loss/FRt1/assignment_loss‚1.3029791076206467 2loss/SRqqt4/assignment_loss‚1.7573333564281897 1loss/FBt4/assignment_loss‚0.20881035269295958 /loss/FBt1/detection_loss‚0.6748635078429016 1loss/FBt3/assignment_loss‚0.19916481241040554 0loss/SRqqt3/detection_loss‚2.345991426188013 _runtime‚2234.829952359 /loss/FBt3/detection_loss‚2.7926050782203675 .loss/FBt4/detection_loss‚2.429759101735221 1loss/SRqqt2/assignment_loss‚1.360895183444794 .loss/FRt2/detection_loss‚2.256246998425453 .loss/FRt4/detection_loss‚2.317205819453332 /loss/FRt1/detection_loss‚1.5485145906076847 0loss/SRqqt4/detection_loss‚2.237404977929765 %loss/total_loss‚40.70127757672505 _step‚162 2loss/FBt2/assignment_loss‚0.059053963463302356 /loss/FRt3/detection_loss‚2.9989350229501723 /loss/FBt2/detection_loss‚2.0035310888290407 .loss/FRt3/assignment_loss‚3.72106853723526 1loss/SRqqt3/assignment_loss‚1.973570343295949 1loss/FBt1/assignment_loss‚0.06944321234132725 % _timestamp‚1.7884805827198663e+09¢˜ÛQž”‚(:‰ ƘèÔþ¼ÿª gpu.0.gpu‚14.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚06l Ÿi‘‚(:Þ ƘèÔÊÑÁ­ disk.sdb1.in‚0 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.md0p1.out‚ 249.83203125 disk.rbd0.out‚ 0.55859375 disk.sdb1.out‚0 disk.nvme0n1.out‚ 16387.71875! disk.sdb2.out‚259.23291015625! disk.sda2.out‚259.23291015625* proc.memory.percent‚18.830513954162598 proc.cpu.threads‚17 disk.rbd0.in‚0 disk.sda.out‚259.23291015625 disk.nvme0n1.in‚ 220.71875! disk.nvme1n1.out‚ 11004.703125 disk.md0.in‚ 64.35546875) proc.memory.availableMB‚ 3472.75390625 cpu‚25.690988059828356 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 27392.421875 disk.rbd2.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 55.390625 disk.md0.out‚ 249.83203125 disk.md0p1.in‚ 64.35546875) disk./.usagePercent‚83.21829426087834 disk.sda.in‚ 55.390625 disk.sdb.out‚259.23291015625# proc.memory.rssMB‚ 3085.19140625 network.sent‚ 4.109857e+06 network.recv‚767284$ disk./.usageGB‚2976.289291381836 disk.rbd2.out‚ 0.55859375$ memory_percent‚78.80399227142334r0x“’‚(:ˆ Õ˜èÔÅÇ« gpu.0.gpu‚59.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚211.828' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.957 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚08òj“‚(:ß Õ˜èÔ£‹ã«! disk.sdb2.out‚260.80908203125 disk.rbd2.in‚0! disk.nvme0n1.out‚ 16387.765625( disk./.usagePercent‚83.2252937516383 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sda1.out‚0 proc.cpu.threads‚17 disk.sda2.in‚ 55.390625 disk.md0p1.in‚ 64.35546875 disk.rbd2.out‚ 0.55859375 disk.nvme0n1.in‚ 220.71875 network.recv‚773190 disk.sdb2.in‚ 8.96484375 disk.md0.out‚ 251.359375 disk.dm-0.in‚ 253.17578125 disk.sdb1.in‚0) proc.memory.availableMB‚ 3473.37109375 disk.dm-0.out‚27585.29296875 disk.sda.out‚260.80908203125# disk.nvme1n1.out‚11197.52734375 disk.sdb.out‚260.80908203125# proc.memory.rssMB‚ 3085.19140625 cpu‚25.689338498862245 disk.md0.in‚ 64.35546875 disk.sda.in‚ 55.390625 disk.sdb.in‚ 8.96484375* proc.memory.percent‚18.830513954162598 disk.md0p1.out‚ 251.359375 disk.rbd0.in‚0 disk.rbd0.out‚ 0.55859375$ memory_percent‚78.80022525787354 disk.nvme1n1.in‚ 32.45703125 network.sent‚ 4.186436e+06% disk./.usageGB‚2976.5396270751953! disk.sda2.out‚260.80908203125bâÌ…ž”‚(:“ ä˜èÔì¦ñª gpu.0.gpu‚80.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚117.81' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚29.452499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¦*ÛÒn•‚(:ã ä˜èÔø콫 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.sda2.in‚ 55.390625$ memory_percent‚82.25855827331543 proc.cpu.threads‚17% disk./.usageGB‚2976.5891647338867 disk.rbd2.out‚ 0.55859375) disk./.usagePercent‚83.22667884530844 disk.md0.in‚ 64.35546875 disk.md0.out‚ 252.64453125 disk.md0p1.out‚ 252.64453125 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚27702.29296875 disk.sda.in‚ 55.390625" disk.nvme0n1.out‚ 16387.9453125# disk.nvme1n1.out‚11314.34765625! disk.sda2.out‚262.16357421875 cpu‚25.68735068588953 network.sent‚ 4.189424e+06 network.recv‚776817 disk.md0p1.in‚ 64.35546875 disk.sda.out‚262.16357421875 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda1.out‚0( proc.memory.availableMB‚ 2906.7578125* proc.memory.percent‚18.830513954162598 disk.sdb.in‚ 8.96484375 disk.sdb.out‚262.16357421875 disk.nvme1n1.in‚ 32.45703125# proc.memory.rssMB‚ 3085.19140625 disk.rbd0.out‚ 0.55859375 disk.sdb2.in‚ 8.96484375! disk.sdb2.out‚262.16357421875ìx_Ù”–‚(:‰ ó˜èÔÒ¿š« gpu.0.gpu‚58.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚140.754' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚35.1885 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¸dÓg—‚(:Ü ó˜èÔÎÑ«# proc.memory.rssMB‚ 3085.19140625 cpu‚25.685918201829406) disk./.usagePercent‚83.22603813549199 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0" disk.nvme0n1.out‚ 16387.9921875# disk.nvme1n1.out‚11491.36328125 disk.sda2.in‚ 55.390625% proc.memory.availableMB‚ 2906.6875 disk.sdb2.in‚ 8.96484375 disk.md0p1.out‚ 254.546875 network.sent‚ 4.195829e+06 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.md0.in‚ 64.35546875 disk.md0p1.in‚ 64.35546875 disk.rbd2.out‚ 0.55859375 disk.nvme0n1.in‚ 220.71875 disk.sda.out‚264.13037109375 disk.sda1.in‚0 proc.cpu.threads‚17$ disk./.usageGB‚2976.566249847412 disk.dm-0.out‚27879.35546875 disk.rbd2.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.96484375! disk.sdb2.out‚264.13037109375$ memory_percent‚82.25898742675781 network.recv‚781539 disk.rbd0.out‚ 0.55859375 disk.sda.in‚ 55.390625 disk.sda1.out‚0! disk.sda2.out‚264.13037109375 disk.md0.out‚ 254.546875* proc.memory.percent‚18.830513954162598 disk.sdb.out‚264.13037109375ŒeÃ*2˜- _wandbruntime‚2286  _runtime‚22867ó©Ç™Á & lr-AdamW/pg1‚0.0009995103963125974 & lr-AdamW/pg2‚0.0009995103963125974 trainer/global_step‚2049 % _timestamp‚1.7884806347464755e+09 _runtime‚2286.856865289 _step‚163ÂØa–ÌšÆ & lr-AdamW/pg2‚0.0009995103963125974 trainer/global_step‚2049 % _timestamp‚1.7884806347464755e+09 _runtime‚2286.856865289 _step‚163 & lr-AdamW/pg1‚0.0009995103963125974£øZ`2›- _wandbruntime‚2286  _runtime‚2286ëð=ªî'œèO G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚529 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 _runtime‚2286.857732963 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚280633080525824 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2435845045248 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚278110922819976 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚82423611 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2246643352064 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚23025286 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚10645896 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚282879740917248 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚37024548 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚37024550 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 trainer/global_step‚2049 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2246643352064 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚45375789 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚23025289 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚282878940401152 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚526 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚280633097565184 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 % _timestamp‚1.7884806347473392e+09 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚241106864053248 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚278110124298732 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚37024548 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚45399061 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚243542530244608 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚278110922819976 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚82423611 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2246643352064 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚23025286 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚10645896 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚282879740917248 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚37024548 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚37024550 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 trainer/global_step‚2049 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2246643352064 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚45375789 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚23025289 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚282878940401152 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚526 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚280633097565184 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 % _timestamp‚1.7884806347473392e+09 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚241106864053248 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚278110124298732 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚37024548 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚45399061 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚243542530244608 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 IDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚529 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 _runtime‚2286.857732963 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚280633080525824 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2435845045248 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 IDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚82462777 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚23036049 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 % _timestamp‚1.7884806356133516e+09 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚10650867 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2239382824618 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚33686916 OGDeviceStatsMonitor.on_train_¯g®|à batch_end/inactive_split.small_pool.current‚524 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚45397477 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚33686389 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2246926214144 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚37042002 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2247709704192 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚276002471459840 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2436997270528 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2247709704192 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚527 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2240164306710 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚280765848877056 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚280765848877056 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚241220982952448 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚82439477 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚37042000 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2436834945024 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚37042002 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚45420775 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚45397477 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚280765831837696 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚82462777 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162325504 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚283013558581248 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚283012758051840 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚283013558581248 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚82439477 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚243658005126656 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475|‰«Dý& ÷M H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚527 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2240164306710 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚280765848877056 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚280765848877056 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚241220982952448 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚82439477 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚37042000 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2436834945024 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚37042002 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚45420775 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚45397477 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚280765831837696 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚82462777 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162325504 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚283013558581248 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚283012758051840 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚283013558581248 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚82439477 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚243658005126656 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚241221007856128 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚82462777 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚23036049 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 % _timestamp‚1.7884806356133516e+09 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚10650867 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2239382824618 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚33686916 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚524 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚45397477 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚33686389 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2246926214144 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚37042002 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2247709704192 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚276002471459840 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2436997270528 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2247709704192¥—N­d2¡- _wandbruntime‚2287  _runtime‚2287ù¸ÇÝ[¢Õ 2loss/SRqqt4/assignment_loss‚1.7988261384589057 1loss/FBt3/assignment_loss‚0.16145766666740827 1loss/SRqqt1/detection_loss‚0.9736777819467314 epoch‚3 0loss/FRt1/assignment_loss‚1.4588436065333905 2loss/SRqqt2/assignment_loss‚1.3514006809338177 .loss/FRt2/detection_loss‚2.263611805000726 0loss/SRqqt4/detection_loss‚2.260199642469806 0loss/FRt2/assignment_loss‚2.5942211059963003 0loss/FBt4/assignment_loss‚0.1539913215516914 /loss/FBt3/detection_loss‚3.3923560231924057 _runtime‚2287.725725287 2loss/SRqqt1/assignment_loss‚1.0434113805690273 2loss/SRqqt3/assignment_loss‚1.8714654832831858 1loss/FBt1/assignment_loss‚0.11132564649375969 /loss/FRt1/detection_loss‚1.7246539347095065 /loss/SRqqt2/detection_loss‚1.43581878085681 /loss/FRt3/assignment_loss‚3.157762475311756 0loss/FRt4/assignment_loss‚3.2179854495184763 /loss/FBt4/detection_loss‚2.1329724584755145 _step‚166 0loss/FBt2/assignment_loss‚0.1511544412650336 /loss/FRt3/detection_loss‚2.9645451647894725 /loss/FRt4/detection_loss‚2.0720734070299103 1loss/SRqqt3/detection_loss‚2.3706479870221195 /loss/FBt1/detection_loss‚0.6274689102885187 .loss/FBt2/detection_loss‚2.061067478524314 % _timestamp‚1.7884806356156485e+09 %loss/total_loss‚41.35093877088859 trainer/global_step‚2049h `£Ú 0loss/FRt4/assignment_loss‚3.2179854495184763 /loss/FBt4/detection_loss‚2.1329724584755145 _step‚166 0loss/FBt2/assignment_loss‚0.1511544412650336 /loss/FRt3/detection_loss‚2.9645451647894725 /loss/FRt4/detection_loss‚2.0720734070299103 1loss/SRqqt3/detection_loss‚2.3706479870221195 /loss/FBt1/detection_loss‚0.6274689102885187 .loss/FBt2/detection_loss‚2.061067478524314 % _timestamp‚1.7884806356156485e+09 %loss/total_loss‚41.35093877088859 trainer/global_step‚2049 2loss/SRqqt4/assignment_loss‚1.7988261384589057 1loss/FBt3/assignment_loss‚0.16145766666740827 1loss/SRqqt1/detection_loss‚0.9736777819467314 epoch‚3 0loss/FRt1/assignment_loss‚1.4588436065333905 2loss/SRqqt2/assignment_loss‚1.3514006809338177 .loss/FRt2/detection_loss‚2.263611805000726 0loss/SRqqt4/detection_loss‚2.260199642469806 0loss/FRt2/assignment_loss‚2.5942211059963003 0loss/FBt4/assignment_loss‚0.1539913215516914 /loss/FBt3/detection_loss‚3.3923560231924057 _runtime‚2287.725725287 2loss/SRqqt1/assignment_loss‚1.0434113805690273 2loss/SRqqt3/assignment_loss‚1.8714654832831858 1loss/FBt1/assignment_loss‚0.11132564649375969 /loss/FRt1/detection_loss‚1.7246539347095065 /loss/SRqqt2/detection_loss‚1.43581878085681 /loss/FRt3/assignment_loss‚3.157762475311756¦-+‚(:ˆ ‚™èÔ˜¬¯¬ gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚166.825' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚41.70625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0S]¥‚(:Ò ‚™èÔ°Ñé­ disk.md0p1.out‚ 256.10546875 disk.rbd2.in‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.nvme0n1.out‚ 16388.125 disk.rbd2.out‚ 0.55859375 network.sent‚ 4.213955e+06 disk.md0.out‚ 256.10546875 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚ 28126.953125# proc.memory.rssMB‚ 3085.19140625* proc.memory.percent‚18.830513954162598 proc.cpu.threads‚17 disk.sdb.out‚ 265.767578125 disk.sdb2.out‚ 265.767578125 disk.md0.in‚ 64.35546875 disk.md0p1.in‚ 64.35546875 disk.nvme1n1.in‚ 32.45703125 cpu‚25.684349519107414) disk./.usagePercent‚83.24352182325684 disk.sdb1.out‚0$ disk./.usageGB‚2977.191551208496 disk.sda2.out‚ 265.767578125 disk.sda.in‚ 55.390625! disk.nvme1n1.out‚ 11738.828125$ memory_percent‚82.25774765014648 network.recv‚785177 disk.sda2.in‚ 55.390625 disk.sdb1.in‚0 disk.sda.out‚ 265.767578125 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.rbd0.in‚0 disk.sda1.in‚0' proc.memory.availableMB‚ 2906.890625_|B†Ÿ¦‚(:” ‘™èÔʦ”« gpu.0.gpu‚69.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚211.163' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚52.790749999999996 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0V÷e*k§‚(:à ‘™èÔîü¬¬ disk.sdb1.out‚0 disk.md0.in‚ 64.35546875 disk.dm-0.in‚ 253.17578125$ memory_percent‚82.25798606872559# proc.memory.rssMB‚ 3085.19140625 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.md0.out‚ 257.70703125 disk.rbd0.in‚0 disk.rbd2.out‚ 0.55859375) disk./.usagePercent‚83.24700759610711 disk.sda.in‚ 55.390625 disk.sda.out‚267.43115234375! disk.sdb2.out‚267.43115234375 disk.rbd2.in‚0* proc.memory.percent‚18.830513954162598 disk.nvme1n1.in‚ 32.45703125 network.sent‚ 4.290454e+06 disk.sdb.out‚267.43115234375 disk.md0p1.in‚ 64.35546875 disk.rbd0.out‚ 0.55859375 cpu‚25.682778806009775! disk.sda2.out‚267.43115234375 disk.dm-0.out‚ 28343.484375" disk.nvme1n1.out‚ 11955.2890625 network.recv‚791079 disk.sdb1.in‚0" disk.nvme0n1.out‚ 16388.1953125 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.sda2.in‚ 55.390625 disk.md0p1.out‚ 257.70703125( proc.memory.availableMB‚ 2906.8515625$ disk./.usageGB‚2977.316219329834 disk.sda1.out‚0 proc.cpu.threads‚17Zœ/Æ“¨‚(:ˆ  ™èÔ‰òÚ« gpu.0.gpu‚63.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚229.256' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.314 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¢CÔj©‚(:ß  ™èÔ¥Èέ proc.cpu.threads‚17 disk.sdb.in‚ 8.96484375 cpu‚25.681271220576754 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 network.recv‚794857 disk.sdb2.in‚ 8.96484375 disk.rbd2.in‚0 disk.sdb1.in‚0( proc.memory.availableMB‚ 2906.6015625) disk./.usagePercent‚83.25399610083227 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 259.65234375 disk.dm-0.in‚ 253.17578125 disk.md0p1.in‚ 64.35546875 disk.sdb2.out‚269.4423828125 disk.dm-0.out‚ 28574.5390625 disk.sda.out‚269.4423828125 disk.sda1.out‚0# disk.nvme0n1.out‚16388.33203125 disk.sdb.out‚269.4423828125$ memory_percent‚82.25951194763184 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.71875# proc.memory.rssMB‚ 3085.19140625* proc.memory.percent‚18.830513954162598 disk.sda.in‚ 55.390625 disk.rbd0.in‚0 disk.sda2.in‚ 55.390625 disk.sda2.out‚269.4423828125 disk.md0.out‚ 259.65234375 disk.rbd0.out‚ 0.55859375 network.sent‚ 4.295695e+06$ disk./.usageGB‚2977.566162109375 disk.rbd2.out‚ 0.55859375# disk.nvme1n1.out‚12186.20703125œE/‡ª‚(:… ¯™èÔâÍÀ« gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0MR8ll«‚(:á ¯™èÔÁ¯Ú« disk.sdb1.out‚0 disk.sda.in‚ 55.390625# disk.nvme0n1.out‚16388.37890625 disk.rbd0.out‚ 0.55859375$ disk./.usageGB‚2977.566162109375 cpu‚25.67974947871918 disk.rbd2.out‚ 0.55859375 disk.sdb1.in‚0" memory_percent‚82.259202003479 network.recv‚799550 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.in‚0 proc.cpu.threads‚17 network.sent‚ 4.302101e+06) disk./.usagePercent‚83.25399610083227 disk.sdb2.in‚ 8.96484375! disk.sdb2.out‚270.99462890625! disk.sda2.out‚270.99462890625 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 261.13671875) proc.memory.availableMB‚ 2906.65234375 disk.dm-0.out‚ 28776.4140625 disk.sda.out‚270.99462890625 disk.sda1.out‚0 disk.dm-0.in‚ 253.17578125 disk.sdb.in‚ 8.96484375 disk.sdb.out‚270.99462890625 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 disk.md0.out‚ 261.13671875# proc.memory.rssMB‚ 3085.19140625* proc.memory.percent‚18.830513954162598 disk.rbd2.in‚0# disk.nvme1n1.out‚12388.03515625³ÒUÌ2¬- _wandbruntime‚2342  _runtime‚2342kJi/Å­¿ % lr-AdamW/pg1‚0.000986531474673461 % lr-AdamW/pg2‚0.000986531474673461 trainer/global_step‚2099 % _timestamp‚1.7884806900119758e+09 _runtime‚2342.123999085 _step‚167½Jˆ(樀 _runtime‚2342.123999085 _step‚167 % lr-AdamW/pg1‚0.000986531474673461 % lr-AdamW/pg2‚0.000986531474673461 trainer/global_step‚2099 % _timestamp‚1.7884806900119758e+09§ǥ̆2¯- _wandbruntime‚2342  _runtime‚2342  \ Ò°èO P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚249307853767168 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚46486813 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚289569850763776 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚37897148 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2291484517600 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚287270646119424 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2299204644352 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚282404331310800 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚34460032 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚2327UCó 2 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚84383963 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚282404314271440 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚249307677010432 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2493647716864 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 _runtime‚2342.124211536 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚289569850763776 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚34460032 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚84383963 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚282404314271440 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚249307677010432 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2493647716864 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 _runtime‚2342.124211536 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚289569850763776 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚46486813 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚289569850763776 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚37897148 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2291484517600 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚287270646119424 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2299204644352 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚282404331310800 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 IDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚249423166822912 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 trainer/global_step‚2099 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚84399829 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2301054473216 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚34475775 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚287403414470656 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚282534981511840 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚23574046 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚37914602 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚287403397431296 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚46485229 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚289704468943872 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚511 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚23574049 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚84423129 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚46508527 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 145548288 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚34475264 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚37914600 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2300270983168 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚46508527 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚282534964472480 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚46485229 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 _step‚169 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚289704468943872 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚287403397431296 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2494823274496 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚284828310256858 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2292547262926 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚287403414470656 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2293328745018 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚37914602 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚84423129 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2301054473216 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2300270983168 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚246928198000128 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚284827511735406 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚84399829 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚249422996370944 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2494968822784 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792ˆäŤ´÷M I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚23574046 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚37914602 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚287403397431296 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚46485229 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚289704468943872 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚511 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚23574049 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚84423129 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚46508527 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 145548288 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚34475264 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚37914600 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2300270983168 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚46508527 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚282534964472480 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚46485229 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 _step‚169 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚289704468943872 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚287403397431296 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2494823274496 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚284828310256858 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2292547262926 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚287403414470656 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2293328745018 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚37914602 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ?6DeviceStatÐ=ÑY sMonitor.on_train_batch_end/num_device_alloc‚1784 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚84423129 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2301054473216 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2300270983168 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚246928198000128 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚284827511735406 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚84399829 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚249422996370944 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2494968822784 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚249423166822912 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 trainer/global_step‚2099 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚84399829 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2301054473216 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚34475775 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚287403414470656 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚282534981511840 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600©G5h2µ- _wandbruntime‚2343  _runtime‚23436Þ“cZ¶Ô -loss/FBt1/detection_loss‚0.69019232881533 _step‚170 2loss/SRqqt4/assignment_loss‚1.4974323851646671 1loss/FBt1/assignment_loss‚0.10414252063524537 2loss/FBt3/assignment_loss‚0.003075047116726637 1loss/SRqqt4/detection_loss‚2.0223352048598544 trainer/global_step‚2099 2loss/SRqqt2/assignment_loss‚1.4078071406301187 _runtime‚2343.122769377 /loss/FRt4/assignment_loss‚3.343470430237123 1loss/SRqqt2/detection_loss‚1.5107481659066921 .loss/FBt4/detection_loss‚2.436310433424436 0loss/FBt4/assignment_loss‚0.5339639638058054 /loss/FRt3/detection_loss‚2.8062006696127355 1loss/SRqqt3/detection_loss‚2.3728754323262433 .loss/FBt2/detection_loss‚2.525520636485173 /loss/FRt2/assignment_loss‚2.854199154810472 0loss/FRt3/assignment_loss‚3.1032417519018054 2loss/SRqqt3/assignment_loss‚1.7623343848265134 -loss/FRt1/detection_loss‚2.01957817331833 0loss/SRqqt1/detection_loss‚1.016021566965231 -loss/FBt3/detection_loss‚5.10331038236618 /loss/FRt4/detection_loss‚2.1172375298632393 0loss/FRt1/assignment_loss‚2.1079539263949676 2loss/FBt2/assignment_loss‚0.057894091001239406 /loss/FRt2/detection_loss‚1.9759913739832964 &loss/total_loss‚44.332443697675146 epoch‚3 % _timestamp‚1.7884806910125322e+09 2loss/SRqqt1/assignment_loss‚0.9606070032237264ÅÆ _·Ù 2loss/SRqqt4/assignment_loss‚1.4974323851646671 1loss/FBt1/assignment_loss‚0.10414252063524537 2loss/FBt3/assignment_loss‚0.003075047116726637 1loss/SRqqt4/detection_loss‚2.0223352048598544 trainer/global_step‚2099 2loss/SRqqt2/assignment_loss‚1.4078071406301187 _runtime‚2343.122769377 /loss/FRt4/assignment_loss‚3.343470430237123 1loss/SRqqt2/detection_loss‚1.5107481659066921 .loss/FBt4/detection_loss‚2.436310433424436 0loss/FBt4/assignment_loss‚0.5339639638058054 /loss/FRt3/detection_loss‚2.8062006696127355 1loss/SRqqt3/detection_loss‚2.3728754323262433 .loss/FBt2/detection_loss‚2.525520636485173 /loss/FRt2/assignment_loss‚2.854199154810472 0loss/FRt3/assignment_loss‚3.1032417519018054 2loss/SRqqt3/assignment_loss‚1.7623343848265134 -loss/FRt1/detection_loss‚2.01957817331833 0loss/SRqqt1/detection_loss‚1.016021566965231 -loss/FBt3/detection_loss‚5.10331038236618 /loss/FRt4/detection_loss‚2.1172375298632393 0loss/FRt1/assignment_loss‚2.1079539263949676 2loss/FBt2/assignment_loss‚0.057894091001239406 /loss/FRt2/detection_loss‚1.9759913739832964 &loss/total_loss‚44.332443697675146 epoch‚3 % _timestamp‚1.7884806910125322e+09 2loss/SRqqt1/assignment_loss‚0.9606070032237264 -loss/FBt1/detection_loss‚0.69019232881533 _step‚170ªoŽOBž¸‚(:“ ¾™èÔÞÓÜ© gpu.0.gpu‚16.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚127.106' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚31.776499999999995 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0â꘢i¹‚(:Þ ¾™èÔ˜ÌÈ« disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125( proc.memory.availableMB‚ 2906.1171875 disk.md0p1.in‚ 64.35546875 disk.rbd0.out‚ 0.55859375 disk.sdb1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.sdb.out‚272.45166015625 network.sent‚ 4.305263e+06! disk.sda2.out‚272.45166015625 disk.md0.in‚ 64.35546875 disk.sdb2.in‚ 8.96484375) disk./.usagePercent‚83.25399610083227 disk.sda2.in‚ 55.390625" disk.nvme1n1.out‚ 12604.5703125$ disk./.usageGB‚2977.566162109375 disk.md0.out‚ 262.53515625 disk.md0p1.out‚ 262.53515625 disk.rbd2.out‚ 0.55859375# proc.memory.rssMB‚ 3085.19140625* proc.memory.percent‚18.830513954162598 cpu‚25.678416047520237 network.recv‚803133 disk.rbd2.in‚0 disk.sda.out‚272.45166015625 disk.rbd0.in‚0 disk.sdb.in‚ 8.96484375! disk.sdb2.out‚272.45166015625 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0" disk.nvme0n1.out‚ 16388.4609375# memory_percent‚82.2624683380127 proc.cpu.threads‚17 disk.dm-0.out‚ 28993.03125 disk.sda.in‚ 55.390625 disk.sda1.in‚0M<󞺂(:“ Í™èÔιë© gpu.0.gpu‚73.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚227.652' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚56.91299999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ëóº{g»‚(:Ü Í™èÔŠöÖª" disk.nvme0n1.out‚ 16388.5078125 disk.sdb2.in‚ 8.96484375$ disk./.usageGB‚2977.038902282715 disk.sdb1.out‚0 disk.sda.in‚ 55.390625! disk.sda2.out‚274.57666015625 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 264.59375( proc.memory.availableMB‚ 2906.3828125 cpu‚25.677219755966274) disk./.usagePercent‚83.23925369540346 disk.dm-0.in‚ 253.17578125 disk.sda1.out‚0 disk.sdb.in‚ 8.96484375# memory_percent‚82.2608470916748 disk.rbd0.out‚ 0.55859375 disk.dm-0.out‚29223.79296875 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚274.57666015625 network.sent‚ 4.392346e+06 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.71875 disk.sdb.out‚274.57666015625 disk.md0.in‚ 64.35546875* proc.memory.percent‚18.830513954162598 network.recv‚808915 disk.rbd0.in‚0 disk.rbd2.out‚ 0.55859375 disk.sdb1.in‚0# disk.nvme1n1.out‚12835.28515625 disk.sda2.in‚ 55.390625 proc.cpu.threads‚17 disk.sda.out‚274.57666015625 disk.md0.out‚ 264.59375# proc.memory.rssMB‚ 3085.19140625 disk.sda1.in‚0>û.œ¼‚(:‘ Ü™èÔ‚Ý© gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚220.183' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚55.04574999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ì|Jn½‚(:ã Ü™èÔâùõ« network.sent‚ 4.400293e+06 disk.sdb1.out‚0 disk.sdb.out‚275.99755859375! disk.sdb2.out‚275.99755859375) disk./.usagePercent‚83.23924388263451 disk.sdb1.in‚0 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.sdb.in‚ 8.96484375 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 265.9453125 disk.dm-0.out‚29488.67578125 disk.rbd2.in‚0" disk.nvme1n1.out‚ 13100.0390625 disk.md0.in‚ 64.35546875 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125 disk.sda1.out‚0# disk.nvme0n1.out‚16388.63671875 cpu‚25.675991121286852 network.recv‚812515 disk.sda2.in‚ 55.390625 disk.rbd2.out‚ 0.55859375 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚ 8.96484375) proc.memory.availableMB‚ 2906.51953125 proc.cpu.threads‚17! disk.sda2.out‚275.99755859375 disk.md0.out‚ 265.9453125 disk.sda.out‚275.99755859375* proc.memory.percent‚18.830513954162598% disk./.usageGB‚2977.0385513305664 disk.rbd0.out‚ 0.55859375$ memory_percent‚82.26001262664795# proc.memory.rssMB‚ 3085.19140625 disk.sda.in‚ 55.390625÷‰ÔÅ2¾- _wandbruntime‚2396  _runtime‚2396ÌsšlÇ¿Á _step‚171 & lr-AdamW/pg1‚0.0009732282510983711 & lr-AdamW/pg2‚0.0009732282510983711 trainer/global_step‚2149 % _timestamp‚1.7884807444325194e+09 _runtime‚2396.542801315jß´ÌÀÆ & lr-AdamW/pg1‚0.0009732282510983711 & lr-AdamW/pg2‚0.0009732282510983711 trainer/global_step‚2149 % _timestamp‚1.7884807444325194e+09 _runtime‚2396.542801315 _step‚171«ã<„2Á- _wandbruntime‚2396  _runtime‚2396î#éê'ÂäO _step‚172 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚47551293 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚293908228752384 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚47574565 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚296261561642496 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚255072750649856 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚252521244341248 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 trainer/global_step‚2149 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚47551293 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚252521219437568 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚293908228752384 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2551691453952 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2551531212288 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚291282271800592 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚288936824323440 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚11148077 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2345430437792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2352549413376 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚291281473279348 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2344648955908 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2353332890112 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚47574565 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚255072935795200 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2353332890112 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚296261561642496 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 " _timestamp‚1.7884807444333e+09 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚296260761126400 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚86344315 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚38769748 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚296260761126400 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚35249363 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309ë€zeï'ÃéO A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 _step‚172 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚47551293 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚293908228752384 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚47574565 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚296261561642496 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚255072750649856 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚252521244341248 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 trainer/global_step‚2149 IDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚47551293 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚252521219437568 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚293908228752384 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2551691453952 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2551531212288 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚291282271800592 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚288936824323440 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚11148077 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2345430437792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2352549413376 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚291281473279348 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2344648955908 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2353332890112 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚47574565 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚255072935795200 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2353332890112 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚296261561642496 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 " _timestamp‚1.7884807444333e+09 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚296260761126400 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚86344315 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚38769748 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚296260761126400 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚35249363 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096¬¯®OÎ2Ä- _wandbruntime‚2397  _runtime‚2397,-u‚&ÅòM ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚289067491563840 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _step‚173 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚294040963024896 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2353615752192 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚294040980064256 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚35265567 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2353615752192 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚291413186225714 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚35265053 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚38787202 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚296395379306496 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚11153518 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2354399242240 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚38787200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 % _timestamp‚1.7884807453777814e+09 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚296394578777088 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2552678618112 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚24112046 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚255188226990592 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚291413984747166 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚289067474524480 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚47596279 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚47572981 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚86383481 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚86360181 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚47596279 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚255188041858560 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚24112049 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841ˆ¤½ý&Æ÷M SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚514 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚511 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚86360181 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2552838846464 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚294040963024896 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2346493183326 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚86383481 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚11153007 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚47572981 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚86383481 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚86360181 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚47596279 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚255188041858560 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚24112049 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚289067491563840 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 _step‚173 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚294040963024896 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2353615752192 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚294040980064256 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚35265567 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2353615752192 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚291413186225714 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚35265053 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚38787202 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚296395379306496 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚11153518 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2354399242240 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚38787200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 % _timestamp‚1.7884807453777814e+09 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚296394578777088 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2552678618112 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚24112046 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚255188226990592 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚291413984747166 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚289067474524480 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚47596279 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚300545777306624 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚39642350 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚24639286 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚300545794345984 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚48662317 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚39642350 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚11399373 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2397813394216 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚24639289 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚48639045 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2609406235136 _step‚176 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚-ì£ó28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚11398838 $ _timestamp‚1.788480799762321e+09 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚302951671489024 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚300545777306624 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2398594876100 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚535 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚258228409581568 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚300545794345984 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚297867147769656 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚2199 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354[”¶…ò'×ìO L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚39642348 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚258228434485248 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚297867946290900 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚300545777306624 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚39642350 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚24639286 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚300545794345984 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚48662317 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚39642350 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚11399373 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2397813394216 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚24639289 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚48639045 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2609406235136 _step‚176 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚11398838 $ _timestamp‚1.788480799762321e+09 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚302951671489024 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚300545777306624 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2398594876100 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚535 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚258228409581568 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚300545794345984 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚297867147769656 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚2199 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2609568573952 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚295600001615840 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚48660733 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2406960521216 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚39659802 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚39659800 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚39659802 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚48684031 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2407744011264 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚508 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚258342553384448 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2407744011264 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚88320533 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚39659800 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2610711356416 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 $ _timestamp‚1.788480800630132e+09 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2398876139542 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚260953289644544 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 _runtime‚2452.741010493 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚300678528618496 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚36053889 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚88343833 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚295599984576480 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 trainer/global_step‚2199 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚303086289669120 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚300678528618496 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚24650049 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚303086289669120 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚260953102415360Å"üFÏÚöM UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2610711356416 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 $ _timestamp‚1.788480800630132e+09 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2398876139542 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚260953289644544 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 _runtime‚2452.741010493 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚300678528618496 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚36053889 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚88343833 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚295599984576480 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 trainer/global_step‚2199 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚303086289669120 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚300678528618496 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚24650049 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚303086289669120 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚260953102415360 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚295600001615840 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚48660733 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2406960521216 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚39659802 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚39659800 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚39659802 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚48684031 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2407744011264 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚508 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚258342553384448 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2407744011264 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚88320533 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚39659800 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784±£µM2Û- _wandbruntime‚2452  _runtime‚2452r¥4VÜÐ /loss/FBt2/detection_loss‚2.1242328584194183 epoch‚3 _runtime‚2452.742098788 1loss/FBt2/assignment_loss‚0.30923490976272205 0loss/FBt3/assignment_loss‚0.2885563050845771 /loss/FBt3/detection_loss‚2.7808189562388828 _step‚178 1loss/SRqqt3/assignment_loss‚1.631286281120518 .loss/FRt4/detection_loss‚2.039890147553076 trainer/global_step‚2199 % _timestamp‚1.7884808006320953e+09 0loss/FRt1/assignment_loss‚1.4888470023870468 .loss/FRt2/detection_loss‚2.319987277971225 1loss/SRqqt1/detection_loss‚1.0104292703134226 0loss/SRqqt3/detection_loss‚2.362922381663668 .loss/FBt4/detection_loss‚2.935409146196702 -loss/FRt2/assignment_loss‚2.4234487722429 .loss/FRt3/detection_loss‚2.797562228209937 0loss/SRqqt4/detection_loss‚2.384329294661681 1loss/SRqqt4/assignment_loss‚2.094605198999246 1loss/FBt4/assignment_loss‚0.34925481164539046 /loss/FBt1/detection_loss‚0.6309796329911893 /loss/FRt3/assignment_loss‚3.110790032059399 2loss/SRqqt2/assignment_loss‚1.3643803379720827 1loss/SRqqt2/detection_loss‚1.3971495705642807 1loss/FBt1/assignment_loss‚0.16008319274393165 %loss/total_loss‚42.28070511277441 0loss/FRt4/assignment_loss‚3.5935093334742954 2loss/SRqqt1/assignment_loss‚0.9555297529463187 /loss/FRt1/detection_loss‚1.7274684175525024’¨c[ÝÕ 0loss/SRqqt3/detection_loss‚2.362922381663668 .loss/FBt4/detection_loss‚2.935409146196702 -loss/FRt2/assignment_loss‚2.4234487722429 .loss/FRt3/detection_loss‚2.797562228209937 0loss/SRqqt4/detection_loss‚2.384329294661681 1loss/SRqqt4/assignment_loss‚2.094605198999246 1loss/FBt4/assignment_loss‚0.34925481164539046 /loss/FBt1/detection_loss‚0.6309796329911893 /loss/FRt3/assignment_loss‚3.110790032059399 2loss/SRqqt2/assignment_loss‚1.3643803379720827 1loss/SRqqt2/detection_loss‚1.3971495705642807 1loss/FBt1/assignment_loss‚0.16008319274393165 %loss/total_loss‚42.28070511277441 0loss/FRt4/assignment_loss‚3.5935093334742954 2loss/SRqqt1/assignment_loss‚0.9555297529463187 /loss/FRt1/detection_loss‚1.7274684175525024 /loss/FBt2/detection_loss‚2.1242328584194183 epoch‚3 _runtime‚2452.742098788 1loss/FBt2/assignment_loss‚0.30923490976272205 0loss/FBt3/assignment_loss‚0.2885563050845771 /loss/FBt3/detection_loss‚2.7808189562388828 _step‚178 1loss/SRqqt3/assignment_loss‚1.631286281120518 .loss/FRt4/detection_loss‚2.039890147553076 trainer/global_step‚2199 % _timestamp‚1.7884808006320953e+09 0loss/FRt1/assignment_loss‚1.4888470023870468 .loss/FRt2/detection_loss‚2.319987277971225 1loss/SRqqt1/detection_loss‚1.0104292703134226²ùø‘Þ‚(:† §šèÔα­ª gpu.0.gpu‚79.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚209.32' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.33 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0xahß‚(:Ý §šèÔíäÝ«# memory_percent‚82.2617769241333# proc.memory.rssMB‚ 3085.19140625 cpu‚25.670006897826475 disk.md0.in‚ 64.35546875 disk.rbd2.out‚ 0.55859375 proc.cpu.threads‚17 disk.nvme1n1.in‚ 32.45703125" disk.nvme1n1.out‚ 13793.9140625 network.sent‚ 4.520993e+06 disk.sdb1.out‚0# disk.nvme0n1.out‚16757.30859375 disk.sdb2.in‚ 8.96484375) proc.memory.availableMB‚ 2906.23046875 disk.sdb.out‚284.3837890625 disk.sdb2.out‚284.3837890625 disk.md0.out‚ 274.0078125 disk.rbd0.in‚0 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.17578125 disk.dm-0.out‚30551.22265625 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.71875 disk.sda.in‚ 55.390625 disk.md0p1.out‚ 274.0078125 disk.rbd2.in‚0 network.recv‚834947( disk./.usagePercent‚83.2539979140613 disk.sda1.out‚0 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625* proc.memory.percent‚18.830513954162598% disk./.usageGB‚2977.5662269592285 disk.sdb1.in‚0 disk.sda.out‚284.3837890625 disk.sda2.out‚284.3837890625 disk.md0p1.in‚ 64.35546875(RÔ•à‚(:Š ¶šèÔÚÔ© gpu.0.gpu‚86.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚230.097' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.52425 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ñþ~Ká‚(:À ¶šèÔËóÖª) disk./.usagePercent‚83.24063569591816" disk.nvme1n1.out‚ 13938.1484375 disk.sdb2.out‚286.4375 disk.sda.in‚ 55.390625 disk.sda2.out‚286.4375 disk.sdb1.out‚0 disk.sda.out‚286.4375# memory_percent‚82.2620153427124 disk.sda2.in‚ 55.390625 disk.nvme0n1.in‚ 220.71875 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 64.35546875 disk.dm-0.out‚ 30840.0390625 disk.sda1.in‚0 disk.sda1.out‚0% disk./.usageGB‚2977.0883293151855 disk.sdb.out‚286.4375 disk.rbd0.out‚ 0.55859375 cpu‚25.66881476165836 network.sent‚ 4.593788e+06 network.recv‚839375 disk.md0p1.in‚ 64.35546875 disk.rbd0.in‚0 disk.rbd2.out‚ 0.55859375* proc.memory.percent‚18.830513954162598 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.md0p1.out‚ 275.984375 disk.rbd2.in‚0# proc.memory.rssMB‚ 3085.19140625 proc.cpu.threads‚17! disk.nvme0n1.out‚ 16901.890625 disk.md0.out‚ 275.984375 disk.sdb1.in‚0) proc.memory.availableMB‚ 2906.19140625 disk.dm-0.in‚ 253.17578125!§Zœ“â‚(:ˆ ÅšèÔóÚ© gpu.0.gpu‚75.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚228.03' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.0075 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Xûª\ã‚(:Ñ ÅšèÔñÛ›« disk.md0.out‚ 277.81640625) disk./.usagePercent‚83.20823403948863 disk.sda2.out‚ 288.3359375 disk.dm-0.out‚31073.54296875 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 55.390625 disk.rbd0.in‚0 disk.sda1.out‚0 disk.md0p1.in‚ 64.35546875 disk.rbd2.in‚0 disk.rbd2.out‚ 0.55859375 disk.nvme0n1.in‚ 220.71875* proc.memory.percent‚18.830513954162598 disk.sdb1.in‚0 disk.sda.in‚ 55.390625( proc.memory.availableMB‚ 2906.4609375 network.sent‚ 4.599645e+06$ disk./.usageGB‚2975.929489135742 disk.sdb.in‚ 8.96484375 disk.sdb2.in‚ 8.96484375 disk.dm-0.in‚ 253.17578125 network.recv‚843506# memory_percent‚82.2603702545166 disk.sdb.out‚ 288.3359375 disk.sdb2.out‚ 288.3359375# disk.nvme1n1.out‚14059.55859375 cpu‚25.667998987882843 proc.cpu.threads‚17 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 277.81640625 disk.rbd0.out‚ 0.55859375 disk.sdb1.out‚0 disk.sda.out‚ 288.3359375! disk.nvme0n1.out‚ 17013.984375# proc.memory.rssMB‚ 3085.19140625g?—T2ä- _wandbruntime‚2501  _runtime‚2501x2S ÆåÀ & lr-AdamW/pg1‚0.0009456935887366917 & lr-AdamW/pg2‚0.0009456935887366917 trainer/global_step‚2249 $ _timestamp‚1.788480849883795e+09 _runtime‚2501.994854631 _step‚179_ϧËæÅ & lr-AdamW/pg2‚0.0009456935887366917 trainer/global_step‚2249 $ _timestamp‚1.788480849883795e+09 _runtime‚2501.994854631 _step‚179 & lr-AdamW/pg1‚0.0009456935887366917³H2ç- _wandbruntime‚2501  _runtime‚2501Ò®ºWí'èçO WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚90241745 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚11650701 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚40514948 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚307183342900224 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚309643382367744 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚535 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚532 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚304453620781208 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2451759314408 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚309642581851648 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚11651233 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2459238951424 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2667531567616 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚302001844427440 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚25177286 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚36827987 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚309642581851648 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2460022428160 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚90265019 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚266603308049920 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚49750069 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚263935624629248 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚307183359939584 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚302001861466800 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚266603131293184 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2667683420672 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2460022428160 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚307183342900224 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784ð‰Mò'éìO G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚307183359939584 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚302001861466800 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚266603131293184 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2667683420672 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2460022428160 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚307183342900224 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚90241745 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚11650701 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚40514948 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚307183342900224 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚309643382367744 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚535 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚532 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚304453620781208 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2451759314408 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚309642581851648 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚11651233 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2459238951424 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2667531567616 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚302001844427440 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚25177286 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚36827987 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚309642581851648 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2460022428160 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚90265019 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚266603308049920 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚49750069 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚263935624629248 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200´á âV2ê- _wandbruntime‚2502  _runtime‚2502¥{¶¦¤ëñM N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 _runtime‚2502.835030927 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚26671861335193¬tS"6 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2461088780288 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚40532400 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 $ _timestamp‚1.788480850724295e+09 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2452822059942 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2460305290240 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚90304185 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚40532402 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚309777200031744 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚307316111251456 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚264049768432128 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚11656188 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚36843707 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚25188046 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚302132511667840 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚49771783 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 trainer/global_step‚2249 _step‚181 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚25188049>©Jü&ìöM K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚90304185 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚40532402 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚309777200031744 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚307316111251456 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚264049768432128 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚11656188 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚36843707 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚25188046 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚302132511667840 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚49771783 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 trainer/global_step‚2249 _step‚181 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚25188049 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 _runtime‚2502.835030927 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚266718613351936 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2461088780288 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚40532400 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 $ _timestamp‚1.788480850724295e+09 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2452822059942 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2460305290240 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0µaˆL2í- _wandbruntime‚2502  _runtime‚2502Î 5ùYîÓ $loss/total_loss‚42.2638651162606 _step‚182 1loss/FBt3/assignment_loss‚0.17227248039470347 0loss/FBt4/assignment_loss‚0.3366283680890774 /loss/FRt3/detection_loss‚3.2982768947663517 1loss/SRqqt3/detection_loss‚2.3286428041756153 .loss/FBt4/detection_loss‚2.385512904326121 % _timestamp‚1.7884808507264948e+09 2loss/SRqqt4/assignment_loss‚1.7966497197466076 0loss/FBt2/assignment_loss‚0.4507926932678351 1loss/SRqqt4/detection_loss‚2.7158384480566347 /loss/FRt1/assignment_loss‚1.403212838628319 1loss/SRqqt1/detection_loss‚0.9126882416336504 _runtime‚2502.836508354 2loss/SRqqt1/assignment_loss‚0.9205597031746723 .loss/FRt4/detection_loss‚2.041399968678303 epoch‚3 0loss/FBt1/assignment_loss‚0.1453717417581934 /loss/FRt1/detection_loss‚1.6704819424894084 /loss/FRt2/detection_loss‚2.1808288955750563 trainer/global_step‚2249 0loss/FRt2/assignment_loss‚2.3782846741378307 0loss/FRt4/assignment_loss‚3.5564531670219597 2loss/SRqqt2/assignment_loss‚1.2935959329727547 2loss/SRqqt3/assignment_loss‚1.7642607318703085 /loss/FBt1/detection_loss‚0.5754868645350673 .loss/FBt2/detection_loss‚2.371741837925381 /loss/FRt3/assignment_loss‚3.473547798136006 1loss/SRqqt2/detection_loss‚1.5786839830436448 .loss/FBt3/detection_loss‚2.512652481857099)^ïØ /loss/FRt1/assignment_loss‚1.403212838628319 1loss/SRqqt1/detection_loss‚0.9126882416336504 _runtime‚2502.836508354 2loss/SRqqt1/assignment_loss‚0.9205597031746723 .loss/FRt4/detection_loss‚2.041399968678303 epoch‚3 0loss/FBt1/assignment_loss‚0.1453717417581934 /loss/FRt1/detection_loss‚1.6704819424894084 /loss/FRt2/detection_loss‚2.1808288955750563 trainer/global_step‚2249 0loss/FRt2/assignment_loss‚2.3782846741378307 0loss/FRt4/assignment_loss‚3.5564531670219597 2loss/SRqqt2/assignment_loss‚1.2935959329727547 2loss/SRqqt3/assignment_loss‚1.7642607318703085 /loss/FBt1/detection_loss‚0.5754868645350673 .loss/FBt2/detection_loss‚2.371741837925381 /loss/FRt3/assignment_loss‚3.473547798136006 1loss/SRqqt2/detection_loss‚1.5786839830436448 .loss/FBt3/detection_loss‚2.512652481857099 $loss/total_loss‚42.2638651162606 _step‚182 1loss/FBt3/assignment_loss‚0.17227248039470347 0loss/FBt4/assignment_loss‚0.3366283680890774 /loss/FRt3/detection_loss‚3.2982768947663517 1loss/SRqqt3/detection_loss‚2.3286428041756153 .loss/FBt4/detection_loss‚2.385512904326121 % _timestamp‚1.7884808507264948e+09 2loss/SRqqt4/assignment_loss‚1.7966497197466076 0loss/FBt2/assignment_loss‚0.4507926932678351 1loss/SRqqt4/detection_loss‚2.7158384480566347¶©+óbð‚(:× ÔšèÔ»šñª disk.md0p1.out‚ 279.3515625$ memory_percent‚82.26194381713867) disk./.usagePercent‚83.20952825838539% disk./.usageGB‚2975.9757766723633 disk.sdb1.in‚0 disk.sdb.out‚289.9287109375 network.recv‚846941! disk.nvme1n1.out‚ 14059.765625 disk.sda.in‚ 55.390625 disk.sdb2.in‚ 8.96484375 disk.md0p1.in‚ 64.35546875 disk.rbd0.out‚ 0.55859375 disk.dm-0.out‚ 31122.609375 network.sent‚ 4.604783e+06 disk.nvme0n1.out‚ 17062.84375 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 55.390625' proc.memory.availableMB‚ 2906.203125 cpu‚25.667014383907222 disk.rbd2.out‚ 0.55859375 disk.sdb1.out‚0 disk.sda.out‚289.9287109375 disk.sda1.out‚0 disk.sdb.in‚ 8.96484375 disk.md0.out‚ 279.3515625# proc.memory.rssMB‚ 3085.19140625* proc.memory.percent‚18.830513954162598 disk.rbd2.in‚0 disk.md0.in‚ 64.35546875 disk.rbd0.in‚0 disk.dm-0.in‚ 253.17578125 disk.nvme0n1.in‚ 220.71875 disk.sdb2.out‚289.9287109375 proc.cpu.threads‚17 disk.sda1.in‚0 disk.sda2.out‚289.9287109375ÉÏÎb“ñ‚(:ˆ ÔšèÔ¿‚Š« gpu.0.gpu‚85.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚226.75' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.6875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ö0*`”ò‚(:‰ ãšèÔëüÝ© gpu.0.gpu‚58.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚232.646' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.1615 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ï´´…nó‚(:ã ãšèÔÃݪ* proc.memory.percent‚18.830513954162598 cpu‚25.66603757675628% disk./.usageGB‚2976.0014686584473 disk.sdb2.in‚ 8.96484375! disk.sdb2.out‚291.27490234375 disk.sda2.in‚ 55.390625! disk.sda2.out‚291.27490234375 disk.dm-0.in‚ 253.17578125 disk.sda.out‚291.27490234375$ memory_percent‚82.26065635681152 network.sent‚ 4.691645e+06 disk.md0.in‚ 64.35546875 disk.nvme0n1.in‚ 220.71875 disk.md0p1.out‚ 280.63671875 disk.sda.in‚ 55.390625 disk.sda1.out‚0" disk.nvme0n1.out‚ 17063.4765625( proc.memory.availableMB‚ 2906.4140625 disk.rbd2.in‚0 disk.nvme1n1.in‚ 32.45703125# proc.memory.rssMB‚ 3085.19140625 proc.cpu.threads‚17 disk.rbd0.out‚ 0.55859375 disk.sdb1.in‚0 disk.sdb1.out‚0# disk.nvme1n1.out‚14060.00390625 disk.sdb.out‚291.27490234375 network.recv‚852006) disk./.usagePercent‚83.21024661706925 disk.md0.out‚ 280.63671875 disk.dm-0.out‚31123.48046875 disk.rbd2.out‚ 0.55859375 disk.md0p1.in‚ 64.35546875 disk.rbd0.in‚0 disk.sda1.in‚0 disk.sdb.in‚ 8.96484375]¶ V”ô‚(:‰ òšèÔæÊ¡« gpu.0.gpu‚71.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚145.438' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚36.3595 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Í‹éÞkõ‚(:à òšèÔ‘µû«) disk./.usagePercent‚83.20680126856064$ disk./.usageGB‚2975.878246307373 disk.sdb.in‚ 8.96484375 disk.sdb.out‚293.20361328125( proc.memory.availableMB‚ 2906.4296875 network.sent‚ 4.696757e+06 network.recv‚855544 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚293.20361328125 disk.sdb1.in‚0# proc.memory.rssMB‚ 3085.19140625 disk.sda.in‚ 55.390625 disk.sda1.in‚0 disk.md0.in‚ 64.35546875 disk.md0.out‚ 282.5078125# disk.nvme1n1.out‚14061.70703125! disk.sda2.out‚293.20361328125 disk.md0p1.in‚ 64.35546875 disk.dm-0.out‚ 31204.796875* proc.memory.percent‚18.830513954162598 disk.sda.out‚293.20361328125# disk.nvme0n1.out‚17143.08984375 disk.sda2.in‚ 55.390625 disk.md0p1.out‚ 282.5078125 disk.dm-0.in‚ 253.17578125 disk.sdb1.out‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.rbd2.in‚0 cpu‚25.664945995605418 disk.sdb2.in‚ 8.96484375 disk.rbd0.in‚0 disk.rbd0.out‚ 0.55859375 disk.rbd2.out‚ 0.55859375$ memory_percent‚82.26056098937988 proc.cpu.threads‚17Ûûfö‚(:Û ›èÔ¿Í« disk.md0.in‚ 64.35546875 disk.md0p1.in‚ 64.35546875 disk.sdb2.in‚ 8.96484375! disk.sdb2.out‚294.87060546875# proc.memory.rssMB‚ 3085.19140625 network.recv‚860383% disk./.usageGB‚2976.1132621765137 disk.rbd2.out‚ 0.55859375 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.71875 disk.sdb.out‚294.87060546875 network.sent‚ 4.70568e+06 disk.rbd0.in‚0 disk.sda1.in‚0# disk.nvme0n1.out‚17229.77734375 disk.rbd2.in‚0 disk.sda.in‚ 55.390625 disk.sda1.out‚0" disk.nvme1n1.out‚ 14062.1015625 disk.sda2.in‚ 55.390625! disk.sda2.out‚294.87060546875) disk./.usagePercent‚83.21337241062359 disk.rbd0.out‚ 0.55859375 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 284.109375 disk.dm-0.in‚ 253.17578125 disk.sdb.in‚ 8.96484375 disk.md0.out‚ 284.109375% proc.memory.availableMB‚ 2906.5625 disk.dm-0.out‚31291.87890625 disk.sdb1.in‚0 disk.sda.out‚294.87060546875$ memory_percent‚82.25975036621094* proc.memory.percent‚18.830513954162598 cpu‚25.66381335934863 proc.cpu.threads‚17ÜÁvX“÷‚(:ˆ ›èÔÔëä« gpu.0.gpu‚31.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚116.306' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.0765 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ëKhÍ2ø- _wandbruntime‚2551  _runtime‚2551¬8¨ÆÇùÁ _runtime‚2551.858974009 _step‚183 & lr-AdamW/pg1‚0.0009314851394960494 & lr-AdamW/pg2‚0.0009314851394960494 trainer/global_step‚2299 % _timestamp‚1.7884808997485723e+09é›öˆÌúÆ & lr-AdamW/pg1‚0.0009314851394960494 & lr-AdamW/pg2‚0.0009314851394960494 trainer/global_step‚2299 % _timestamp‚1.7884808997485723e+09 _runtime‚2551.858974009 _step‚183·Ÿ<ñ‡2û- _wandbruntime‚2551  _runtime‚2551QIáçdüèO OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚269642789869568 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 % _timestamp‚1.7884808997494469e+09 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚316333492214272 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚313820925533184 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚272368587218944 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚313820908493824 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2513367197184 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚41387550 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚37618248 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2512583720448 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚41387550 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚311039295271516 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2504923752716 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚313820925533184 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚92225371 KEDeviceStatsMonitor.on_train_batch_start/allocation.QþŠlarge_pool.current‚2 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚92202097 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚25715289 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚50837821 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2513367197184 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚313820908493824 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚50814549 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚316334292730368 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚11903503 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚50837821 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚37618792 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2725616398336 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 trainer/global_step‚2299 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚50814549 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚541 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2512583720448 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚544 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 IDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2512583720448 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚544 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚316333492214272 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚313820925533184 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚272368587218944 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚313820908493824 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2513367197184 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚41387550 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚37618248 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2512583720448 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚41387550 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚311039295271516 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2504923752716 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚313820925533184 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚92225371 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚92202097 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚25715289 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚50837821 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2513367197184 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚313820908493824 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚50814549 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚316334292730368 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚11903503 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚50837821 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚37618792¸s¹ún2þ- _wandbruntime‚2552  _runtime‚2552Ý 7ø&ÿòM MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚2299 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚92264537 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚50859535 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚269756933672448 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2514433549312 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚269756958576128 % _timestamp‚1.7884809005983202e+09 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚11907999 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚272483717434880 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2505986498250 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚41405000 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚25726046 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2726933505024 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚313953659805696 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2514433549312 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚41405002 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚311171008218090 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚92241237 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚50836237 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚313953659805696 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚37634045 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚25726049 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚313953676845056 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚92264537 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚37634564 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚272483892081152 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚308665004680480 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 _runtime‚2552.709529743 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2513650059264 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚11908515 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚41405000 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 _step‚185 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚316467309864960 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚311170209696638û×ÝÉ6€÷M SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 149742592 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚37634045 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚25726049 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚313953676845056 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚92264537 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚37634564 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚272483892081152 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚308665004680480 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 _runtime‚2552.709529743 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2513650059264 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚11908515 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚41405000 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 _step‚185 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚316467309864960 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚311170209696638 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚2299 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚92264537 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚50859535 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚269756933672448 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2514433549312 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚269756958576128 % _timestamp‚1.7884809005983202e+09 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚11907999 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚272483717434880 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2505986498250 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚516 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E?DeviceStatsMonitor.on_train_batch_e¤–ÀaÇ nd/active.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚41405000 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚25726046 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2726933505024 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚313953659805696 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2514433549312 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚41405002 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚311171008218090 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚92241237 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚50836237 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚313953659805696 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 B²ÊŒÄ _runtime‚2603.551352123 _step‚187 % lr-AdamW/pg1‚0.000916998348216661 % lr-AdamW/pg2‚0.000916998348216661 trainer/global_step‚2349 % _timestamp‚1.7884809514410088e+09»ƒP½2- _wandbruntime‚2603  _runtime‚2603Û†ÚFî'ŽèO PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚42260148 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚320458474087424 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚278133736398336 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚2349 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚42260150 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚51925573 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚323025203092992 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚320458491126784 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚51902301 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2783579628032 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚38408127 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚520 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚315066864531440 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚323025203092992 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚320458491126784 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚12155361 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚317624171240580 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 _step‚188 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚323024402576896 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚323024402576896 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2566711966208 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚26253289 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 % _timestamp‚1.7884809514422154e+09 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚51925573 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚42260148 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚275350004917248 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚278133559641600 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2557306709140 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚26253286 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _runtime‚2603.554258757 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚94162449 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚42260150 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2783731481088 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚51902301šì2ßó'íO YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚317624969761824 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2558088191024 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _runtime‚2603.554258757 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚94162449 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚42260150 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2783731481088 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚51902301 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚42260148 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚320458474087424 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚278133736398336 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 trainer/global_step‚2349 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚42260150 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚51925573 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚323025203092992 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚320458491126784 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚51902301 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2783579628032 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚38408127 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚520 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚315066864531440 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚323025203092992 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚320458491126784 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚12155361 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚317624171240580 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 _step‚188 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚323024402576896 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚323024402576896 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2566711966208 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚26253289 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 % _timestamp‚1.7884809514422154e+09 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚51925573 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚42260148 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚275350004917248 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚278133559641600 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2557306709140 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚26253286 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 IDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚94224889 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚275464123816448 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 trainer/global_step‚2349 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚320591242438656 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚94201589 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚38424344 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚513 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚315197514732480 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚42277600 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚320591225399296 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚320591242438656 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚12159782 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2558369454466 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚323159020756992 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚51947287 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚323158220227584 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚42277602 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚38423828 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2566994828288 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚94224889 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ý&’÷M \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2567778318336 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚275464148720128 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚513 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚315197514732480 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚42277600 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚320591225399296 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚320591242438656 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚12159782 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2558369454466 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚323159020756992 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚51947287 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚323158220227584 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚42277602 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚38423828 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2566994828288 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚94224889 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚26264049 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2559150936558 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚42277602 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2784892722176 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚42277600 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚317756682708398 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2567778318336 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚94224889 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚275464123816448 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 trainer/global_step‚2349 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚320591242438656 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚94201589 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚38424344 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 EDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚329715312939520 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2610471147448 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚12406245 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚52990053 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚283899004429312 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚321599391622800 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2611252629332 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2620056735232 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚96146075 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2841809368064 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚43132748 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚43132748 _step‚192 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚96122801 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 170465280 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚329716113455616 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚327096056720384 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚53013325 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚53013325 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ZFDeviceStatsàpSí(Monitor.on_train_batch_start/inactive_split_bytes.all.freed‚283898833964032 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚327096056720384 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚43132750 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 trainer/global_step‚2399 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚39197531 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚26791289 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚52990053 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚39198060 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚526 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚281057170157568 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚26791286 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 % _timestamp‚1.7884810054127152e+09 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2619273258496 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚529 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2620056735232 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚321599374583440 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 145561600 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚329716113455616 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2841663806464 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚324210644252132 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 _runtime‚2657.525286121 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚329715312939520 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚26791286 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 % _timestamp‚1.7884810054127152e+09 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2619273258496 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚529 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2620056735232 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚321599374583440 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 145561600 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚329716113455616 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2841663806464 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚324210644252132 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 _runtime‚2657.525286121 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚329715312939520 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚329715312939520 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2610471147448 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚12406245 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚52990053 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚283899004429312 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚321599391622800 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2611252629332 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2620056735232 M@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚96146075 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2841809368064 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚43132748 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚43132748 _step‚192 E8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚96122801 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 170465280 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360À¥@,2¤- _wandbruntime‚2658  _runtime‚2658H/Ûtø&¥òM NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚53035039 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚12411705 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 % _timestamp‚1.7884810063251011e+09 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚39213239 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2842821703680 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚96185241 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚96161941 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚321730024784480 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2611533892774 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚96185241 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚321730041823840 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚329849130590208 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚329849931119616 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚26802049 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚284014135664128 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚43150202 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚324342357198706 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2620339597312 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2612315374866 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚327228808032256 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2620339597312 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2612315374866 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚327228808032256 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚12411705 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.wQµle current‚ 25794969600 % _timestamp‚1.7884810063251011e+09 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚39213239 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 2842821703680 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚96185241 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚96161941 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚321730024784480 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2611533892774 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚96185241 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚321730041823840 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚329849130590208 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚329849931119616 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚26802049 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚284014135664128ÁÑêÙf2§- _wandbruntime‚2658  _runtime‚26584E.Z¨Ô 2loss/SRqqt3/assignment_loss‚1.6893254801010091 /loss/FRt2/detection_loss‚2.0625536613857625 $ _timestamp‚1.788481006327355e+09 epoch‚3 /loss/FBt1/detection_loss‚0.7056591219776733 _runtime‚2658.437380304 /loss/FRt2/assignment_loss‚2.144426542459075 2loss/SRqqt1/assignment_loss‚0.9884109268151223 0loss/FBt4/assignment_loss‚0.4300368573833566 1loss/SRqqt2/detection_loss‚1.4116160140874294 /loss/FRt1/detection_loss‚1.8402689991725816 .loss/FRt3/detection_loss‚3.027213530881064 1loss/SRqqt3/detection_loss‚2.3247769912083944 trainer/global_step‚2399 .loss/FBt3/detection_loss‚2.678694627501748 &loss/total_loss‚41.609771303929406 /loss/FRt3/assignment_loss‚3.925554015806743 1loss/FBt1/assignment_loss‚0.10093573682612818 1loss/FBt3/assignment_loss‚0.14937453714678253 /loss/FRt4/detection_loss‚2.2668764619111945 0loss/SRqqt1/detection_loss‚1.110398480117321 .loss/FBt2/detection_loss‚2.153530565591959 .loss/FBt4/detection_loss‚2.412069583311677 0loss/FRt1/assignment_loss‚1.4674040383762783 0loss/FRt4/assignment_loss‚3.4934429912776737 1loss/SRqqt2/assignment_loss‚1.117959173421304 2loss/SRqqt4/assignment_loss‚1.6189744397017516 1loss/SRqqt4/detection_loss‚2.4582244429671976 1loss/FBt2/assignment_loss‚0.03204408450018001 _step‚194ì •_©Ù 1loss/FBt3/assignment_loss‚0.14937453714678253 /loss/FRt4/detection_loss‚2.2668764619111945 0loss/SRqqt1/detection_loss‚1.110398480117321 .loss/FBt2/detection_loss‚2.153530565591959 .loss/FBt4/detection_loss‚2.412069583311677 0loss/FRt1/assignment_loss‚1.4674040383762783 0loss/FRt4/assignment_loss‚3.4934429912776737 1loss/SRqqt2/assignment_loss‚1.117959173421304 2loss/SRqqt4/assignment_loss‚1.6189744397017516 1loss/SRqqt4/detection_loss‚2.4582244429671976 1loss/FBt2/assignment_loss‚0.03204408450018001 _step‚194 2loss/SRqqt3/assignment_loss‚1.6893254801010091 /loss/FRt2/detection_loss‚2.0625536613857625 $ _timestamp‚1.788481006327355e+09 epoch‚3 /loss/FBt1/detection_loss‚0.7056591219776733 _runtime‚2658.437380304 /loss/FRt2/assignment_loss‚2.144426542459075 2loss/SRqqt1/assignment_loss‚0.9884109268151223 0loss/FBt4/assignment_loss‚0.4300368573833566 1loss/SRqqt2/detection_loss‚1.4116160140874294 /loss/FRt1/detection_loss‚1.8402689991725816 .loss/FRt3/detection_loss‚3.027213530881064 1loss/SRqqt3/detection_loss‚2.3247769912083944 trainer/global_step‚2399 .loss/FBt3/detection_loss‚2.678694627501748 &loss/total_loss‚41.609771303929406 /loss/FRt3/assignment_loss‚3.925554015806743 1loss/FBt1/assignment_loss‚0.10093573682612818±ö Ïžª‚(:“ ù›èÔÔÀÑ« gpu.0.gpu‚55.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚215.839' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚53.95974999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0nn·jo«‚(:ä ù›èÔè…™¬ disk.rbd0.in‚0 disk.rbd0.out‚ 0.55859375) disk./.usagePercent‚83.24377663526809 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 296.73046875 disk.sda.out‚307.95263671875 disk.sdb.in‚ 8.96484375 disk.md0.out‚ 296.73046875 disk.dm-0.in‚ 253.1796875 disk.rbd2.in‚0# proc.memory.rssMB‚ 3085.19140625% disk./.usageGB‚2977.2006645202637) proc.memory.availableMB‚ 2906.22265625* proc.memory.percent‚18.830513954162598 network.recv‚895186 disk.nvme0n1.in‚ 220.72265625! disk.nvme0n1.out‚ 18534.359375" disk.nvme1n1.out‚ 14063.7578125! disk.sdb2.out‚307.95263671875 disk.dm-0.out‚ 32598.1171875 disk.rbd2.out‚ 0.55859375$ memory_percent‚82.26182460784912 disk.sdb1.in‚0 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb2.in‚ 8.96484375! disk.sda2.out‚307.95263671875 disk.md0p1.in‚ 64.35546875 cpu‚25.655882189145306 proc.cpu.threads‚17 disk.sda.in‚ 55.390625 disk.sdb.out‚307.95263671875 disk.sda2.in‚ 55.390625 network.sent‚ 4.924423e+06 disk.sdb1.out‚0¶û3’¬‚(:‡ ˆœèÔÌéóª gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚36.0 gpu.0.powerWatts‚113.798' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.4495 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0'Îùk­‚(:à ˆœèÔ¥×È« cpu‚25.674970110375416% disk./.usageGB‚2977.3232612609863 disk.rbd0.out‚ 0.55859375$ memory_percent‚82.26330280303955# proc.memory.rssMB‚ 3085.19140625 proc.cpu.threads‚17 network.sent‚ 4.999523e+06 disk.rbd0.in‚0 disk.dm-0.in‚ 253.1796875 disk.rbd2.out‚ 0.55859375 disk.sda.out‚310.0478515625 network.recv‚899545 disk.md0.in‚ 64.35546875 disk.sda1.in‚0* proc.memory.percent‚18.830513954162598 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚310.0478515625) proc.memory.availableMB‚ 2905.98046875# disk.nvme0n1.out‚18708.42578125) disk./.usagePercent‚83.24720449144941 disk.sdb2.out‚310.0478515625 disk.md0.out‚ 298.76171875 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 298.76171875 disk.rbd2.in‚0 disk.sda.in‚ 55.390625 disk.nvme0n1.in‚ 220.72265625 disk.nvme1n1.out‚ 14063.9375 disk.sda2.out‚310.0478515625 disk.sdb1.in‚0 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625 disk.sdb1.out‚0 disk.sda1.out‚0 disk.sdb2.in‚ 8.96484375 disk.dm-0.out‚32772.36328125žaÞu“®‚(:ˆ —œèÔâý–« gpu.0.gpu‚1.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚36.0 gpu.0.powerWatts‚114.131' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.53275 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0@ä2l¯‚(:á —œèÔ•ý¹« disk.nvme0n1.in‚ 220.72265625 disk.sdb2.in‚ 8.96484375& proc.memory.availableMB‚ 2905.34375 disk.sda1.in‚0 disk.sdb.out‚311.57568359375 network.sent‚ 5.005971e+06 disk.md0.out‚ 300.23828125 disk.dm-0.in‚ 253.1796875 disk.dm-0.out‚ 33060.796875 disk.sdb1.in‚0# memory_percent‚82.2671890258789 network.recv‚903895 disk.md0p1.in‚ 64.35546875 disk.sdb.in‚ 8.96484375# proc.memory.rssMB‚ 3085.19140625 cpu‚25.705076895176607 disk.md0.in‚ 64.35546875 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚311.57568359375% disk./.usageGB‚2977.5743370056152 disk.sda.in‚ 55.390625 disk.sda1.out‚0 disk.sda.out‚311.57568359375 disk.sda2.in‚ 55.390625 disk.rbd0.in‚0 disk.rbd2.out‚ 0.55859375* proc.memory.percent‚18.830513954162598! disk.sda2.out‚311.57568359375 disk.md0p1.out‚ 300.23828125 disk.rbd0.out‚ 0.55859375 disk.rbd2.in‚0# disk.nvme0n1.out‚18996.76171875# disk.nvme1n1.out‚14064.03515625 proc.cpu.threads‚17( disk./.usagePercent‚83.2542246743526:æÿ4m°‚(:â ¦œèÔ¢àߪ" disk.nvme1n1.out‚ 14064.2578125# memory_percent‚82.2624683380127 cpu‚25.73186766255827 disk.sdb2.in‚ 8.96484375! disk.sdb2.out‚313.09326171875 disk.dm-0.out‚33343.73046875 disk.sdb1.in‚0 disk.sdb1.out‚0 network.recv‚907483 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.72265625) disk./.usagePercent‚83.25419459608254 disk.md0.out‚ 301.6953125 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 301.6953125! disk.sda2.out‚313.09326171875 network.sent‚ 5.008994e+06% disk./.usageGB‚2977.5732612609863 disk.rbd0.in‚0 disk.dm-0.in‚ 253.1796875 disk.rbd2.in‚0 disk.rbd2.out‚ 0.55859375 disk.sda.out‚313.09326171875 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 64.35546875 disk.rbd0.out‚ 0.55859375 disk.sda.in‚ 55.390625 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625* proc.memory.percent‚18.830513954162598( proc.memory.availableMB‚ 2906.1171875 proc.cpu.threads‚17 disk.sda1.in‚0# disk.nvme0n1.out‚19279.47265625 disk.sdb.out‚313.09326171875# proc.memory.rssMB‚ 3085.19140625Cfzx±‚(:’ ¦œèÔÀƒ« gpu.0.gpu‚32.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚241.333' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚60.33325000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0x`²A2²- _wandbruntime‚2718  _runtime‚27189…Rá O³•¨ @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.4583333134651184 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9991881251335144 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 7 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.2388889044523239 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.01785714365541935 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9133333563804626 ;"Purity/1FRt1SRqqt2FBt/event_purity‚0.014285714365541935 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.028888888657093048 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 jet/accuracy_1_of_6‚1 particle/accuracy_1_of_6‚1 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.5225898027420044 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 +jet/accuracy_2_of_3‚0.26141053438186646 (particle/f_score‚0.40529710054397583 7 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.4000000059604645 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9878812432289124 7 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.2426072210073471 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.3333333432674408 * Purity/4FRt*SRqqt*FBt/FRt_purity‚0.125 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9770370125770569 * Purity/1FRt*SRqqt3FBt/FRt_purity‚0.625 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.019565245136618614 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 +jet/accuracy_3_of_5‚0.11769217997789383 particle/accuracy_5_of_5‚1 7 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.3499999940395355 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.31035467982292175 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 (particle/accuracy‚0.8511950373649597 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.19295956194400787 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5072222352027893 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.16787439584732056 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ("Purity/3FRt1SRqqt2FBt/SRqqt_purity‚1 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 *jet/accuracy_2_of_5‚0.5125448703765869 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.19072788953781128 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 +jet/accuracy_2_of_2‚0.11395998299121857 +jet/accuracy_3_of_4‚0.06605221331119537 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.26209786534309387 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9793910980224609 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9915950298309326 ,"Purity/1FRt*SRqqt3FBt/event_purity‚0.125 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.20737327635288239 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.49629631638526917 7 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.1805555671453476 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.49375006556510925 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9270833134651184 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 +jet/accuracy_3_of_3‚0.03390463814139366 *jet/accuracy_2_of_6‚0.5789473652839661 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.20032314956188202 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09403757750988007 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.005071360617876053 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.03474075347185135 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 7validation_average_jet_accuracy‚0.44425928592681885 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 jet/accuracy_5_of_7‚0 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.40532878041267395 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.4166666567325592 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 _runtime‚2718.836099036 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9939343929290771 8"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.508331835269928 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt0SRqqt2FBt/event_purity‚0.26939722895622253 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.21201740205287933 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 particle/accuracy_1_of_3‚1 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.3669932782649994 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.2674897313117981 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 particle/accuracy_7_of_7‚1 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.41369685530662537 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 jet/accuracy_3_of_7‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7078104615211487 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.00358422938734293 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 7 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.4000000059604645 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5239569544792175 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.19788847863674164 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.20000000298023224 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 * Purity/4FRt*SRqqt0FBt/FRt_purity‚0.125 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.10000000149011612 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5865245461463928 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5740740895271301 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.1805555671453476 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 7 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.1806917041540146 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9930351972579956 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.36338382959365845 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9076628684997559 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.027276964858174324 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9975894093513489 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11467991769313812 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.19924072921276093 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 8"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.506028950214386 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9901965856552124 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5698979496955872 +"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.75 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.5907737612724304 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 particle/accuracy_3_of_6‚1 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.5011841058731079 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.01785714365541935 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.46829473972320557 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.5064436197280884 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.49381718039512634 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5310465097427368 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 9"Purity/1FRt*SRqqt2FBt/event_purity‚0.1290971338748932 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 9"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.4795863628387451 8 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.42116397619247437 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.030023133382201195 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 particle/accuracy_4_of_6‚1 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9925026297569275 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ("Purity/3FRt*SRqqt2FBt/SRqqt_purity‚1 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.48203423619270325 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 8"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.540368378162384 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.8809523582458496 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 ,"Purity/*FRt0SRqqt3FBt/event_purity‚0.125 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9811090230941772 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.18060319125652313 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3435555696487427 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 particle/accuracy_2_of_5‚1 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.2857142984867096 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07641161978244781 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9907440543174744 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 :"Purity/*FRt0SRqqt4FBt/event_purity‚0.20000000298023224 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.41847988963127136 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.09865079075098038 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.42105263471603394 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9855701327323914 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.17945930361747742 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5299475193023682 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 *jet/accuracy_2_of_4‚0.3844200074672699 ,"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.375 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3974359333515167 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.4206349551677704 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.17086294293403625 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.7444444894790649 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.21568626165390015 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.20391124486923218 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9792627096176147 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5872154831886292 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 +jet/accuracy_4_of_5‚0.02369351126253605 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.26196783781051636 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8123970627784729 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3671875 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.19337409734725952 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.35101011395454407 jet/accuracy_5_of_6‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5790286064147949 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.22181788086891174 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.5145249962806702 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.4305875897407532 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 8"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.534173846244812 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.2845517098903656 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.2857142984867096 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.006451612804085016 *jet/accuracy_1_of_5‚0.9548383355140686 ,particle/sensitivity‚0.32473793625831604 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6492935419082642 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0011520737316459417 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.40625 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9980875849723816 _step‚195 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4850544035434723 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 particle/accuracy_2_of_2‚1 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6176470518112183 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.055248335003852844 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 8"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.568257749080658 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5560286641120911 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.4162244498729706 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.00909090880304575 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.09482758492231369 6 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.265341192483902 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.03349669277667999 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5446428656578064 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 +particle/specificity‚0.9486367702484131 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6071428656578064 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 jet/accuracy_2_of_7‚0.5 particle/accuracy_6_of_7‚1 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 particle/accuracy_4_of_4‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.38059160113334656 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2579246759414673 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5552226305007935 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.06744128465652466 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.2814900279045105 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.5320513248443604 *jet/accuracy_1_of_4‚0.9280620217323303 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2512010335922241 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 9"Purity/*FRt*SRqqt4FBt/event_purity‚0.1666666716337204 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.03846153989434242 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4927535951137543 jet/accuracy_4_of_7‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.22068887948989868 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.99067509174346\8fbE92 7 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.1922401338815689 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.967886745929718 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt0SRqqt*FBt/event_purity‚0.2397163212299347 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_2‚1 +"Purity/0FRt0SRqqt4FBt/event_purity‚0.25 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.42590707540512085 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8730158805847168 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.40715181827545166 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.21201184391975403 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.21245409548282623 particle/accuracy_1_of_4‚1 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1428571492433548 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6134024858474731 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.26955392956733704 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3342846930027008 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.40740785002708435 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04529242217540741 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_5‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.4583333432674408 9"Purity/*FRt*SRqqt1FBt/event_purity‚0.4241867959499359 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.20000000298023224 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 +"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.75 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4757973849773407 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9822741150856018 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9738863706588745 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7640852928161621 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 jet/accuracy_5_of_5‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3067364990711212 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7675438523292542 particle/accuracy_2_of_3‚1 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.5075529217720032 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5500757694244385 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2907227873802185 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 jet/accuracy_4_of_6‚0 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 7 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.9983022212982178 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.010114261880517006 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.21201740205287933 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_2_of_6‚1 particle/accuracy_6_of_6‚1 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.17282643914222717 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.5298849940299988 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_3_of_4‚1 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9988052845001221 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.013262025080621243 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3888889253139496 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.4816020131111145 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 7"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.48870849609375 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6048811078071594 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4803796708583832 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.5476190447807312 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5658820867538452 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9899741411209106 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5210894346237183 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.4583333432674408 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 jet/accuracy_6_of_6‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9984467029571533 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.23888887465000153 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.19947700202465057 particle/accuracy_2_of_4‚1 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5510488748550415 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.05389144644141197 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.1666666716337204 particle/accuracy_1_of_7‚1 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6000000238418579 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5788177251815796 & Purity/1FRt2SRqqt1FBt/FBt_purity‚1 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.013219347223639488 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5086805820465088 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 9"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.4877517521381378 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.12666666507720947 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.004608294926583767 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2561381459236145 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.5476190447807312 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 8"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.464169442653656 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.23349566757678986 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 particle/accuracy_3_of_7‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5063627362251282 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.4020717740058899 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11637625843286514 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 particle/accuracy_5_of_6‚1 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.24566034972667694 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9893691539764404 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.3076923191547394 )loss/val_total_loss‚40.47226516507694 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4806042015552521 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.3928571343421936 particle/accuracy_2_of_7‚1 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.5105555653572083 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 particle/accuracy_5_of_7‚1 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.48076921701431274 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.5011841058731079 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.4234127402305603 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.4736842215061188 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9987940192222595 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_4_of_7‚1 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 +jet/accuracy_1_of_1‚0.49325135350227356 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 8 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.45102038979530334 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24775132536888123 particle/accuracy_1_of_1‚1 +jet/accuracy_3_of_6‚0.25438597798347473 8"Purity/0FRt1SRqqt*FBt/event_purity‚0.413703054189682 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_6_of_7‚0 ) Purity/3FRt1SRqqt2FBt/FRt_purity‚0.25 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 *jet/accuracy_1_of_3‚0.8724405765533447 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 % _timestamp‚1.7884810667224538e+09 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18746934831142426 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.08791004866361618 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5132872462272644 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.27589285373687744 jet/accuracy_1_of_7‚1 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 5 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.20505291223526 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.19950087368488312 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.48431161046028137 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4657738506793976 +"Purity/0FRt*SRqqt4FBt/event_purity‚0.25 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.19177894294261932 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.09259258955717087 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3295523524284363 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.03690475970506668 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9833204746246338 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.020612617954611778 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.35126370191574097 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.01515151560306549 epoch‚3 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.20149600505828857 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9900369048118591 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.23204761743545532 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 trainer/global_step‚2415 9"Purity/*FRt*SRqqt2FBt/event_purity‚0.2071484923362732 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4793921411037445 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.015207373537123203 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9152778387069702 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 particle/accuracy_4_of_5‚1 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9882023930549622 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.2222222238779068 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 6 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.899177074432373 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9806547164916992 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.40433788299560547 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.5007510185241699 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.004608294926583767 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4059069752693176 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.43246716260910034 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.4791666865348816 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.5013037323951721 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9979106187820435 9"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.4673493504524231 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.1805555671453476 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5362135171890259 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.20050561428070068 jet/accuracy_7_of_7‚0A5Êß:´š¨ ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 +particle/specificity‚0.9486367702484131 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6071428656578064 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 jet/accuracy_2_of_7‚0.5 particle/accuracy_6_of_7‚1 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 particle/accuracy_4_of_4‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.38059160113334656 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2579246759414673 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5552226305007935 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.06744128465652466 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.2814900279045105 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.5320513248443604 *jet/accuracy_1_of_4‚0.9280620217323303 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2512010335922241 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 9"Purity/*FRt*SRqqt4FBt/event_purity‚0.1666666716337204 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.03846153989434242 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4927535951137543 jet/accuracy_4_of_7‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.22068887948989868 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9906750917434692 7 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.1922401338815689 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.967886745929718 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt0SRqqt*FBt/event_purity‚0.2397163212299347 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_2‚1 +"Purity/0FRt0SRqqt4FBt/event_purity‚0.25 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.42590707540512085 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8730158805847168 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.40715181827545166 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.21201184391975403 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.21245409548282623 particle/accuracy_1_of_4‚1 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1428571492433548 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6134024858474731 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.26955392956733704 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3342846930027008 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.40740785002708435 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04529242217540741 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_5‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.4583333432674408 9"Purity/*FRt*SRqqt1FBt/event_purity‚0.4241867959499359 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.20000000298023224 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 +"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.75 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4757973849773407 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9822741150856018 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9738863706588745 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7640852928161621 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 jet/accuracy_5_of_5‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3067364990711212 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7675438523292542 particle/accuracy_2_of_3‚1 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.5075529217720032 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5500757694244385 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2907227873802185 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 jet/accuracy_4_of_6‚0 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 7 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.9983022212982178 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.010114261880517006 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.21201740205287933 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_2_of_6‚1 particle/accuracy_6_of_6‚1 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.17282643914222717 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.5298849940299988 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_3_of_4‚1 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9988052845001221 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.013262025080621243 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3888889253139496 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.4816020131111145 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 7"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.48870849609375 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6048811078071594 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4803796708583832 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.5476190447807312 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5658820867538452 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9899741411209106 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5210894346237183 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.4583333432674408 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 jet/accuracy_6_of_6‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9984467029571533 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.23888887465000153 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.19947700202465057 particle/accuracy_2_of_4‚1 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5510488748550415 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.05389144644141197 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.1666666716337204 particle/accuracy_1_of_7‚1 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6000000238418579 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5788177251815796 & Purity/1FRt2SRqqt1FBt/FBt_purity‚1 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.013219347223639488 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5086805820465088 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 9"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.4877517521381378 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.12666666507720947 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.004608294926583767 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2561381459236145 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.5476190447807312 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 8"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.464169442653656 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.23349566757678986 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 particle/accuracy_3_of_7‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5063627362251282 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.4020717740058899 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11637625843286514 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 particle/accuracy_5_of_6‚1 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.24566034972667694 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9893691539764404 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.3076923191547394 )loss/val_total_loss‚40.47226516507694 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4806042015552521 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.3928571343421936 particle/accuracy_2_of_7‚1 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.5105555653572083 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 particle/accuracy_5_of_7‚1 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.48076921701431274 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.5011841058731079 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.4234127402305603 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.4736842215061188 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9987940192222595 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_4_of_7‚1 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 +jet/accuracy_1_of_1‚0.49325135350227356 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 8 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.45102038979530334 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24775132536888123 particle/accuracy_1_of_1‚1 +jet/accuracy_3_of_6‚0.25438597798347473 8"Purity/0FRt1SRqqt*FBt/event_purity‚0.413703054189682 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_6_of_7‚0 ) Purity/3FRt1SRqqt2FBt/FRt_purity‚0.25 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 *jet/accuracy_1_of_3‚3£ ÜBY0.8724405765533447 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 % _timestamp‚1.7884810667224538e+09 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18746934831142426 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.08791004866361618 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5132872462272644 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.27589285373687744 jet/accuracy_1_of_7‚1 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 5 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.20505291223526 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.19950087368488312 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.48431161046028137 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4657738506793976 +"Purity/0FRt*SRqqt4FBt/event_purity‚0.25 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.19177894294261932 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.09259258955717087 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3295523524284363 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.03690475970506668 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9833204746246338 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.020612617954611778 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.35126370191574097 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.01515151560306549 epoch‚3 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.20149600505828857 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9900369048118591 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.23204761743545532 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 trainer/global_step‚2415 9"Purity/*FRt*SRqqt2FBt/event_purity‚0.2071484923362732 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4793921411037445 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.015207373537123203 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9152778387069702 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 particle/accuracy_4_of_5‚1 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9882023930549622 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.2222222238779068 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 6 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.899177074432373 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9806547164916992 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.40433788299560547 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.5007510185241699 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.004608294926583767 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4059069752693176 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.43246716260910034 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.4791666865348816 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.5013037323951721 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9979106187820435 9"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.4673493504524231 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.1805555671453476 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5362135171890259 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.20050561428070068 jet/accuracy_7_of_7‚0 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.4583333134651184 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9991881251335144 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 7 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.2388889044523239 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.01785714365541935 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9133333563804626 ;"Purity/1FRt1SRqqt2FBt/event_purity‚0.014285714365541935 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.028888888657093048 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 jet/accuracy_1_of_6‚1 particle/accuracy_1_of_6‚1 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.5225898027420044 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 +jet/accuracy_2_of_3‚0.26141053438186646 (particle/f_score‚0.40529710054397583 7 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.4000000059604645 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9878812432289124 7 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.2426072210073471 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.3333333432674408 * Purity/4FRt*SRqqt*FBt/FRt_purity‚0.125 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9770370125770569 * Purity/1FRt*SRqqt3FBt/FRt_purity‚0.625 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.019565245136618614 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 +jet/accuracy_3_of_5‚0.11769217997789383 particle/accuracy_5_of_5‚1 7 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.3499999940395355 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.31035467982292175 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 (particle/accuracy‚0.8511950373649597 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.19295956194400787 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5072222352027893 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.16787439584732056 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ("Purity/3FRt1SRqqt2FBt/SRqqt_purity‚1 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 *jet/accuracy_2_of_5‚0.5125448703765869 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.19072788953781128 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 +jet/accuracy_2_of_2‚0.11395998299121857 +jet/accuracy_3_of_4‚0.06605221331119537 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.26209786534309387 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9793910980224609 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9915950298309326 ,"Purity/1FRt*SRqqt3FBt/event_purity‚0.125 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.20737327635288239 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.49629631638526917 7 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.1805555671453476 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.49375006556510925 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9270833134651184 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 +jet/accuracy_3_of_3‚0.03390463814139366 *jet/accuracy_2_of_6‚0.5789473652839661 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.20032314956188202 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09403757750988007 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.005071360617876053 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.03474075347185135 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 7validation_average_jet_accuracy‚0.44425928592681885 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 jet/accuracy_5_of_7‚0 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.40532878041267395 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.4166666567325592 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 _runtime‚2718.836099036 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9939343929290771 8"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.508331835269928 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt0SRqqt2FBt/event_purity‚0.26939722895622253 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.21201740205287933 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 particle/accuracy_1_of_3‚1 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.3669932782649994 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.2674897313117981 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 particle/accuracy_7_of_7‚1 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.41369685530662537 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 jet/accuracy_3_of_7‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7078104615211487 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.00358422938734293 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 7 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.4000000059604645 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5239569544792175 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.19788847863674164 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.20000000298023224 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 * Purity/4FRt*SRqqt0FBt/FRt_purity‚0.125 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.10000000149011612 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5865245461463928 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5740740895271301 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.1805555671453476 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 7 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.1806917041540146 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9930351972579956 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.36338382959365845 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9076628684997559 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.027276964858174324 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9975894093513489 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11467991769313812 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.19924072921276093 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 8"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.506028950214386 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9901965856552124 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5698979496955872 +"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.75 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.5907737612724304 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 particle/accuracy_3_of_6‚1 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.5011841058731079 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.01785714365541935 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.46829473972320557 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.5064436197280884 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.49381718039512634 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5310465097427368 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 9"Purity/1FRt*SRqqt2FBt/event_purity‚0.1290971338748932 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 9"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.4795863628387451 8 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.42116397619247437 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.030023133382201195 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 particle/accuracy_4_of_6‚1 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9925026297569275 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ("Purity/3FRt*SRqqt2FBt/SRqqt_purity‚1 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.48203423619270325 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 8"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.540368378162384 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.8809523582458496 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 ,"Purity/*FRt0SRqqt3FBt/event_purity‚0.125 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9811090230941772 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.18060319125652313 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3435555696487427 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 particle/accuracy_2_of_5‚1 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.2857142984867096 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07641161978244781 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9907440543174744 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 :"Purity/*FRt0SRqqt4FBt/event_purity‚0.20000000298023224 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.41847988963127136 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.09865079075098038 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.42105263471603394 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9855701327323914 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.17945930361747742 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5299475193023682 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 *jet/accuracy_2_of_4‚0.3844200074672699 ,"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.375 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3974359333515167 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.4206349551677704 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.17086294293403625 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.7444444894790649 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.21568626165390015 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.20391124486923218 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9792627096176147 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5872154831886292 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 +jet/accuracy_4_of_5‚0.02369351126253605 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.26196783781051636 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8123970627784729 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3671875 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.19337409734725952 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.35101011395454407 jet/accuracy_5_of_6‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5790286064147949 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.22181788086891174 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.5145249962806702 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.4305875897407532 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 8"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.534173846244812 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.2845517098903656 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.2857142984867096 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.006451612804085016 *jet/accuracy_1_of_5‚0.9548383355140686 ,particle/sensitivity‚0.32473793625831604 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6492935419082642 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0011520737316459417 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.40625 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9980875849723816 _step‚195 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4850544035434723 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 particle/accuracy_2_of_2‚1 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6176470518112183 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.055248335003852844 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 8"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.568257749080658 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5560286641120911 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.4162244498729706 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.00909090880304575 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.09482758492231369 6 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.265341192483902 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.03349669277667999 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5446428656578064 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05Ú}¹lµ‚(:á µœèÔœ¯Åª disk.rbd2.in‚0 disk.sda1.out‚0! disk.sdb2.out‚315.05908203125 disk.md0.out‚ 303.60546875 proc.memory.rssMB‚ 3086.3125 proc.cpu.threads‚17 disk.rbd2.out‚ 0.55859375 disk.sda.out‚315.05908203125 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚ 8.96484375! disk.sda2.out‚315.05908203125 disk.dm-0.out‚34187.53515625( proc.memory.availableMB‚ 2905.1015625 disk.rbd0.out‚ 0.55859375 disk.sdb1.out‚0# disk.nvme1n1.out‚14064.49609375* proc.memory.percent‚18.837356567382812 cpu‚25.734681077544238 disk.sda.in‚ 55.390625 disk.nvme0n1.in‚ 220.72265625 network.sent‚ 5.015502e+06 disk.sdb.out‚315.05908203125 disk.dm-0.in‚ 253.1796875$ disk./.usageGB‚2977.575481414795 disk.sdb1.in‚0 disk.rbd0.in‚0 network.recv‚911939" disk.nvme0n1.out‚ 20123.0390625 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625 disk.md0p1.in‚ 64.35546875 disk.md0p1.out‚ 303.60546875) disk./.usagePercent‚83.25425667251223 disk.sda1.in‚0 disk.md0.in‚ 64.35546875$ memory_percent‚82.26866722106934fJ Í“¶‚(:ˆ µœèÔ¢¿üª gpu.0.gpu‚64.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚123.712' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.928 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚064žŸ·‚(:” Äœè԰䜫 gpu.0.gpu‚83.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚122.818' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚30.704500000000003 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0}òäb¸‚(:× ÄœèÔÉѬ disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚ 8.96484375 disk.sda2.in‚ 55.390625 network.sent‚ 5.118527e+06 disk.md0p1.out‚305.125 disk.rbd0.out‚ 0.55859375 proc.memory.rssMB‚ 3086.3125 proc.cpu.threads‚17) disk./.usagePercent‚83.23945059074576! disk.nvme0n1.out‚ 20287.203125# disk.nvme1n1.out‚14064.80078125 disk.sdb.out‚316.64990234375 disk.sdb2.in‚ 8.96484375! disk.sda2.out‚316.64990234375) proc.memory.availableMB‚ 2905.25390625 disk.sda1.in‚0! disk.sdb2.out‚316.64990234375 disk.rbd2.in‚0 disk.sdb1.in‚0* proc.memory.percent‚18.837356567382812 disk.dm-0.out‚34352.00390625 disk.sda.out‚316.64990234375$ memory_percent‚82.26773738861084 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 64.35546875 disk.md0.out‚305.125 disk.md0p1.in‚ 64.35546875 disk.sdb1.out‚0 disk.sda.in‚ 55.390625 cpu‚25.733105465190278$ disk./.usageGB‚2977.045944213867 disk.sda1.out‚0 disk.dm-0.in‚ 253.32421875 network.recv‚916243 disk.rbd0.in‚0 disk.rbd2.out‚ 0.55859375}°9Î2¹- _wandbruntime‚2759  _runtime‚2759¶I#ƺÀ & lr-AdamW/pg2‚0.0008872383437295261 trainer/global_step‚2449 % _timestamp‚1.7884811076178489e+09 _runtime‚ 2759.72887424 _step‚196 & lr-AdamW/pg1‚0.0008872383437295261<<ÿ˻Š& lr-AdamW/pg1‚0.0008872383437295261 & lr-AdamW/pg2‚0.0008872383437295261 trainer/global_step‚2449 % _timestamp‚1.7884811076178489e+09 _runtime‚ 2759.72887424 _step‚196Äá)’2¼- _wandbruntime‚2759  _runtime‚2759Òjõƒ½çO MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 trainer/global_step‚2449 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚40432351 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚292034892060672 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 $ _timestamp‚1.788481107619074e+09 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2919383636992 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚44418268 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚40432836 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚336550608618496 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚289115360764928 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚289115335861248 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147658752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚12781347 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚54362798 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚339242783601664 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚54339526 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚339242783601664 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚336550591579136 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚292034719498240 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _step‚197 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚336550608618496 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚336550591579136 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚44418268 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2919531295744 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚44418270 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2692975499264 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 _runtime‚2759.729845345 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2692192022528 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚44418270 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚336550608618496 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚336550591579136 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚44418268 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2919531295744 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚44418270 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2692975499264 IDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 _runtime‚2759.729845345 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2692192022528 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚44418270 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2919383636992 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚44418268 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚40432836 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚336550608618496 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚289115360764928 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚289115335861248 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147658752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚12781347 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚54362798 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚339242783601664 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚54339526 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 IDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚339242783601664 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚336550591579136 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚292034719498240 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360Å4¦Ø’¿‚(:‡ ÓœèÔˆ†Ê¬ gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚196.422' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚49.1055 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ýYÌdÀ‚(:Ù ÓœèÔÛ—Œ®" disk.nvme1n1.out‚ 14064.8984375 disk.rbd0.in‚0$ memory_percent‚82.27066993713379( proc.memory.availableMB‚ 2904.7734375 disk.md0p1.in‚ 64.35546875 disk.sda1.out‚0 disk.md0.out‚ 306.6953125 disk.rbd0.out‚ 0.55859375* proc.memory.percent‚18.837356567382812 disk.sda2.out‚318.2978515625( disk./.usagePercent‚83.2394404579952 disk.sdb1.out‚0 disk.sdb2.in‚ 8.96484375 disk.sdb2.out‚318.2978515625 disk.md0p1.out‚ 306.6953125 disk.sdb1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.96484375 cpu‚25.73191635971955 proc.cpu.threads‚17 network.sent‚ 5.135577e+06 proc.memory.rssMB‚ 3086.3125 disk.dm-0.in‚ 253.32421875# disk.nvme0n1.out‚21004.61328125 disk.sdb.out‚318.2978515625 disk.sda2.in‚ 55.390625 disk.md0.in‚ 64.35546875 network.recv‚920928 disk.dm-0.out‚35069.51171875 disk.rbd2.in‚0 disk.rbd2.out‚ 0.55859375 disk.sda.in‚ 55.390625 disk.sda.out‚318.2978515625$ disk./.usageGB‚2977.045581817627 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875â@PÃ2Á- _wandbruntime‚2760  _runtime‚2760c“zø&ÂòM @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 _runtime‚2760.724332133 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚292150040026624 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚336683342891008 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚44435722 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚12786790 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚12786306 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚339376601252352 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚98820234 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚44435722 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚336683359930368 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚27661764 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2694041851392 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚336683359930368 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚44435720 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚54384512 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚330928402517344 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚54361214 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2920703813632 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚292150208381440 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2684223834016 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 _step‚198 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2694041851392 % _timestamp‚1.7884811086121585e+09 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚54361214 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚40448070 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚44435720 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚339377401781760 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚333612609312000 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2685005316108 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚487 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚98796934 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚339377401781760 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2693258361344 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚98796934 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 trainer/global_step‚2449 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚98820234 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 168354816 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0AI1DSÃ÷M ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚336683359930368 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚27661764 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2694041851392 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚336683359930368 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚44435720 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚54384512 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚330928402517344 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚54361214 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 2920703813632 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚292150208381440 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2684223834016 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 _step‚198 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2694041851392 % _timestamp‚1.7884811086121585e+09 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚54361214 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚40448070 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚44435720 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚339377401781760 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚333612609312000 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2685005316108 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚487 C6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚98796934 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚339377401781760 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2693258361344 G:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚98796934 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 SEDeviceStatsMonitor.on_train_batch_end/req2i ת uested_bytes.small_pool.peak‚ 975420792 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 trainer/global_step‚2449 G:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚98820234 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 168354816 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 _runtime‚2760.724332133 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚292150040026624 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚336683342891008 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚44435722 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚12786790 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚12786306 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚339376601252352 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚98820234 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚44435722 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600Æ~Ùû2Ä- _wandbruntime‚2760  _runtime‚2760K`ñ&XÅÒ 2loss/SRqqt3/assignment_loss‚1.4546628060113442 /loss/FRt1/detection_loss‚1.8366374522447586 1loss/SRqqt4/detection_loss‚2.5527930420637133 .loss/FBt4/detection_loss‚2.162798225879669 %loss/total_loss‚39.36174601200108 0loss/FBt3/assignment_loss‚0.4022654941266713 /loss/FRt1/assignment_loss‚1.243312992769129 2loss/SRqqt2/assignment_loss‚1.2170336685474898 1loss/FBt1/assignment_loss‚0.06003770164443729 .loss/FBt1/detection_loss‚0.595951895664942 epoch‚4 .loss/FRt2/detection_loss‚2.168750439701896 0loss/SRqqt3/detection_loss‚2.255720371870618 .loss/FBt2/detection_loss‚2.257136495340438 trainer/global_step‚2449 .loss/FRt3/detection_loss‚2.718190503792024 .loss/FRt4/detection_loss‚2.196747645978075 0loss/FRt4/assignment_loss‚3.3493945549945443 2loss/SRqqt4/assignment_loss‚1.7139838501811027 0loss/FBt4/assignment_loss‚0.2730719353172345 0loss/FRt2/assignment_loss‚2.3463590226675333 2loss/SRqqt1/assignment_loss‚0.8670942040130966 1loss/SRqqt2/detection_loss‚1.6072253422274934 % _timestamp‚1.7884811086155796e+09 _runtime‚2760.725820489 1loss/FBt2/assignment_loss‚0.03079925783268187 1loss/SRqqt1/detection_loss‚0.8654989151093434 /loss/FBt3/detection_loss‚2.4664175113042197 _step‚199 /loss/FRt3/assignment_loss‚2.719862682718626­S]Æ× %loss/total_loss‚39.36174601200108 0loss/FBt3/assignment_loss‚0.4022654941266713 /loss/FRt1/assignment_loss‚1.243312992769129 2loss/SRqqt2/assignment_loss‚1.2170336685474898 1loss/FBt1/assignment_loss‚0.06003770164443729 .loss/FBt1/detection_loss‚0.595951895664942 epoch‚4 .loss/FRt2/detection_loss‚2.168750439701896 0loss/SRqqt3/detection_loss‚2.255720371870618 .loss/FBt2/detection_loss‚2.257136495340438 trainer/global_step‚2449 .loss/FRt3/detection_loss‚2.718190503792024 .loss/FRt4/detection_loss‚2.196747645978075 0loss/FRt4/assignment_loss‚3.3493945549945443 2loss/SRqqt4/assignment_loss‚1.7139838501811027 0loss/FBt4/assignment_loss‚0.2730719353172345 0loss/FRt2/assignment_loss‚2.3463590226675333 2loss/SRqqt1/assignment_loss‚0.8670942040130966 1loss/SRqqt2/detection_loss‚1.6072253422274934 % _timestamp‚1.7884811086155796e+09 _runtime‚2760.725820489 1loss/FBt2/assignment_loss‚0.03079925783268187 1loss/SRqqt1/detection_loss‚0.8654989151093434 /loss/FBt3/detection_loss‚2.4664175113042197 _step‚199 /loss/FRt3/assignment_loss‚2.719862682718626 2loss/SRqqt3/assignment_loss‚1.4546628060113442 /loss/FRt1/detection_loss‚1.8366374522447586 1loss/SRqqt4/detection_loss‚2.5527930420637133 .loss/FBt4/detection_loss‚2.162798225879669ÇÊh‘Ç‚(:† âœèÔ²‹½© gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.408' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.602 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0j®fÈ‚(:Û âœèÔëúŒ¬) disk./.usagePercent‚83.24014676403891 disk.sda2.in‚ 55.390625 disk.sdb1.in‚0 disk.sda.in‚ 55.390625* proc.memory.percent‚18.837356567382812 proc.cpu.threads‚17 disk.md0p1.in‚ 64.35546875 disk.sdb1.out‚0 network.sent‚ 5.197327e+06 network.recv‚925203# disk./.usageGB‚2977.07084274292 disk.nvme1n1.in‚ 32.45703125 disk.sda1.in‚0) proc.memory.availableMB‚ 2904.69140625 proc.memory.rssMB‚ 3086.3125 disk.sdb.out‚319.87548828125 disk.md0.in‚ 64.35546875 disk.rbd0.in‚0 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚35363.57421875 disk.rbd2.in‚0 disk.sda1.out‚0! disk.nvme1n1.out‚ 14142.734375 disk.sdb.in‚ 8.96484375 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚21220.83984375 disk.sdb2.in‚ 8.96484375 disk.md0.out‚ 308.203125 disk.md0p1.out‚ 308.203125 disk.rbd2.out‚ 0.55859375 cpu‚25.730539246750663! disk.sdb2.out‚319.87548828125! disk.sda2.out‚319.87548828125 disk.sda.out‚319.87548828125# memory_percent‚82.2711706161499 ^Ôn”É‚(:‰ ñœèÔ͵ҫ gpu.0.gpu‚77.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚232.986' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.2465 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÅVã5cÊ‚(:Ø ñœèÔ«¥œ­( disk./.usagePercent‚83.2402184399165 disk.dm-0.out‚35510.25390625" disk.nvme1n1.out‚ 14145.3828125 proc.memory.rssMB‚ 3086.3125 proc.cpu.threads‚17) proc.memory.availableMB‚ 2904.91015625 disk.sda2.in‚ 55.390625 disk.nvme1n1.in‚ 32.45703125$ memory_percent‚82.26983547210693% disk./.usageGB‚2977.0734062194824 disk.md0p1.in‚ 64.35546875 disk.rbd2.in‚0 disk.sda.out‚ 322.162109375# disk.nvme0n1.out‚21364.87109375 disk.md0.out‚ 310.4140625 disk.md0p1.out‚ 310.4140625 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 0.55859375 disk.sdb1.in‚0 disk.sda.in‚ 55.390625 disk.sda1.in‚0 disk.sdb2.out‚ 322.162109375 disk.sdb.in‚ 8.96484375 disk.sdb.out‚ 322.162109375 network.recv‚930763 disk.sda2.out‚ 322.162109375 disk.sdb1.out‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875* proc.memory.percent‚18.837356567382812 disk.md0.in‚ 64.35546875 disk.rbd0.out‚ 0.55859375 disk.sdb2.in‚ 8.96484375 cpu‚25.729029125588273 disk.rbd0.in‚0 network.sent‚ 5.276365e+06ÜG½„•Ë‚(:Š €èÔ´ØÖ© gpu.0.gpu‚69.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚167.157' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚41.78925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0é¢-@gÌ‚(:Ü €èÔõÕϬ disk.md0p1.in‚ 64.35546875 disk.rbd0.in‚0) disk./.usagePercent‚83.24371125236189! disk.sdb2.out‚323.69775390625) proc.memory.availableMB‚ 2904.79296875 disk.sdb2.in‚ 8.96484375 disk.rbd0.out‚ 0.55859375 disk.rbd2.in‚0 disk.sda.in‚ 55.390625! disk.sda2.out‚323.69775390625* proc.memory.percent‚18.837356567382812 proc.cpu.threads‚17# disk./.usageGB‚2977.19832611084 disk.sda.out‚323.69775390625 disk.rbd2.out‚ 0.55859375$ memory_percent‚82.27055072784424 cpu‚25.727743543620786 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚21365.08984375 disk.md0.out‚ 311.890625 disk.dm-0.in‚ 253.32421875 proc.memory.rssMB‚ 3086.3125 network.sent‚ 5.28148e+06 network.recv‚934398 disk.sdb1.out‚0 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚ 8.96484375 disk.sdb.out‚323.69775390625 disk.sda2.in‚ 55.390625 disk.sdb1.in‚0 disk.sda1.out‚0# disk.nvme1n1.out‚14232.26171875 disk.md0.in‚ 64.35546875 disk.md0p1.out‚ 311.890625 disk.dm-0.out‚ 35597.3515625Ñû¤Š2Í- _wandbruntime‚2814  _runtime‚2814sµ\ÇÎÁ % _timestamp‚1.7884811628859177e+09 _runtime‚2814.996254042 _step‚200 & lr-AdamW/pg1‚0.0008719899780750765 & lr-AdamW/pg2‚0.0008719899780750765 trainer/global_step‚2499’#nÚÌÏÆ _step‚200 & lr-AdamW/pg1‚0.0008719899780750765 & lr-AdamW/pg2‚0.0008719899780750765 trainer/global_step‚2499 % _timestamp‚1.7884811628859177e+09 _runtime‚2814.996254042ÈþØ7~2Ð- _wandbruntime‚2815  _runtime‚2815Üèüêò'ÑìO D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚343188157172736 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚45290870 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚345933693964288 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2746320268288 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚518 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13029962 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2977283010048 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2745536791552 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2745536791552 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚297799833918976 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚297799648773632 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2977122768384 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚337330245328944 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚345933693964288 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚343188174212096 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚41218969 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚343188174212096 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚41218448 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚28189007 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚294822526005248 trainer/global_step‚2499 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚55427278 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚340066570855942 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚55427278 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2746320268288 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚340067369377186 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2737107008882 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚45290868 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚45290870 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚345934494480384 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚343188157172736 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚45290868 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚337330262368304 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 % _timestamp‚1.7884811628871503e+09ÆÖª÷'ÒñO JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚337330245328944 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚345933693964288 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚343188174212096 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚41218969 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚343188174212096 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚41218448 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚28189007 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚294822526005248 trainer/global_step‚2499 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚55427278 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚340066570855942 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚55427278 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2746320268288 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚340067369377186 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2737107008882 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚45290868 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚45290870 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚345934494480384 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚343188157172736 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚45290868 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚337330262368304 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 % _timestamp‚1.7884811628871503e+09 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚343188157172736 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚45290870 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚345933693964288 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2746320268288 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚518 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13029962 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 2977283010048 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2745536791552 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2745536791552 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚297799833918976 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚297799648773632 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 2977122768384 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784Éú³2Ó- _wandbruntime‚2816  _runtime‚2816ú0ÚÇõÔöM WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚343320908484608 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 100780586 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚41234195 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _step‚202 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚55448966 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚45308322 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚28199767 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚297915122925056 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2747386620416 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚13034942 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚343320908484608 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 100757286 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2746603130368 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚55472264 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚28199764 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚13034431 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚294936669808128 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚340199082323760 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚346068312144384 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚55472264 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚514 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚294936694711808 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 % _timestamp‚1.7884811639647558e+09 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚346067511614976 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚337460912569344 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 100780586 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162325504 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚55448966 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚45308320 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚41234709 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 100757286 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2738169754416 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2737388272324 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚297914935695872 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚340198283802308 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚343320925523968 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0EH ™'ÕûM YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2747386620416 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚343320908484608 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 100757286 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2746603130368 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚55472264 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚28199764 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚13034431 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚294936669808128 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚340199082323760 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚346068312144384 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚55472264 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚514 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚294936694711808 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 % _timestamp‚1.7884811639647558e+09 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚346067511614976 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚337460912569344 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 100780586 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162325504 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚55448966 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚45308320 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚41234709 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 100757286 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2738169754416 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2737388272324 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚297914935695872 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚340198283802308 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚343320925523968 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚343320908484608 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 100780586 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚41234195 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _step‚202 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚55448966 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚45308322 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚28199767 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚297915122925056 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2747386620416 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚13034942 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚352624604326912 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚46163468 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚303564756812800 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2790271447190 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚13278986 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚349825722766336 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚352624604326912 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚42005990 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚28727004 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚343862772420304 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚2865.889286936 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚349825739805696 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2799665037312 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3035015759872 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚349825739805696 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚343862755380944 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚46163470 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13279505 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚346652245346250 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚56538302 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚346653043867494 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚352625404843008 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚300529716149248 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 % _timestamp‚1.7884812137789505e+09 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3034859712512 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0Ÿ ¬ñ÷'æñO RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚2865.889286936 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚349825739805696 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2799665037312 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3035015759872 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚349825739805696 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚343862755380944 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚46163470 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13279505 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚346652245346250 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚56538302 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚346653043867494 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚352625404843008 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚300529716149248 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 % _timestamp‚1.7884812137789505e+09 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3034859712512 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 trainer/global_step‚2549 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚46163468 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚56515030 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚28727007 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚352624604326912 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚46163468 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚303564756812800 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2790271447190 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚13278986 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚349825722766336 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚352624604326912 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚42005990 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚28727004 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚343862772420304 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600Í,wê2ç- _wandbruntime‚2866  _runtime‚2866:Õ1ƒû&èõM ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚349958474078208 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3036022707712 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚349958474078208 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚352759222507008 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚300643884855808 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚352759222507008 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚46180922 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚46180920 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚56536718 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 trainer/global_step‚2549 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚56560016 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚346784756814068 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚46180920 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚56536718 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2790552710632 $ _timestamp‚1.788481214638943e+09 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚303679882659840 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _step‚206 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚42021778 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 102717638 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚300643859952128 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚349958491117568 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2799947899392 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚28737764 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚13284014 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚515 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚343993422621344 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 102740938 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚565600165n‚oéúM D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 102717638 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 _runtime‚2866.749690545 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2800731389440 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚13284526 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 102740938 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2799947899392 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚42021778 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 102717638 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚300643859952128 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚349958491117568 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2799947899392 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚28737764 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚13284014 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚515 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚343993422621344 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 102740938 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚56560016 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚349958474078208 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3036022707712 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚349958474078208 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚352759222507008 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚300643884855808 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚352759222507008 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚46180922 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚46180920 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚56536718 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 trainer/global_step‚2549 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚56560016 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚346784756814068 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 J=DeviceStatsMonitor.on_train_batch_end[¸˜[‘ /active.large_pool.freed‚46180920 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚56536718 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2790552710632 $ _timestamp‚1.788481214638943e+09 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚303679882659840 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _step‚206 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚359315514689536 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚47036068 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 104662124 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚359316315205632 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2852226329600 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚359316315205632 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚13528418 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3092715609600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13528921 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚356463288359936 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3092557465088 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚29265007 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚47036068 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚47036070 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚47036070 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚356463288359936 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 % _timestamp‚1.7884812642104084e+09 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚356463305399296 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚42793422 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2842654403614 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2843435885498 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 104638850 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚309329646806528 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚306236931196928 trainer/global_step‚2599 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2853009806336 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 % _timestamp‚1.7884812642104084e+09 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚356463305399296 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚42793422 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2842654403614 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2843435885498 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 104638850 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚309329646806528 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚306236931196928 trainer/global_step‚2599 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2853009806336 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚359315514689536 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚47036068 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 104662124 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚359316315205632 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2852226329600 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚359316315205632 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚13528418 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3092715609600 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13528921 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚356463288359936 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3092557465088 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚29265007 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚47036068 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚47036070 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0Ñ=¬ˆ2ù- _wandbruntime‚2917  _runtime‚29179q2rúöM =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚57624470 % _timestamp‚1.7884812650536215e+09 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚359450132869632 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 _step‚210 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚353370431304376 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚350525932673344 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚ß´‘§á"0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚42809197 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚309444785497088 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 104677990 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 104701290 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚57647768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 166257664 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2843717148940 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚29275767 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚500 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚353369632782924 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 104701290 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚57624470 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚309444951754752 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2854076158464 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚47053520 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2854076158464 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚47053520 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2853292668416 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚503 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚356596039671808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚359450132869632 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 trainer/global_step‚2599 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚57647768 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚356596056711168 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚13533433 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚29275764 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚350525915633984 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚47053522 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚359449332340224•1i'ûûM K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 2853292668416 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚503 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚356596039671808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚359450132869632 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 trainer/global_step‚2599 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚57647768 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚356596056711168 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚13533433 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚29275764 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚350525915633984 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚47053522 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚359449332340224 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚57624470 % _timestamp‚1.7884812650536215e+09 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚359450132869632 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 _step‚210 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚353370431304376 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚350525932673344 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚42809197 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚309444785497088 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 104677990 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 104701290 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚57647768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 166257664 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2843717148940 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚29275767 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚500 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚353369632782924 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 104701290 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚57624470 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚309444951754752 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2854076158464 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚47053520 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2854076158464 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚47053520Òƒ¤W2ü- _wandbruntime‚2917  _runtime‚2917LܯÊ^ýØ /loss/FBt3/detection_loss‚2.3450694346427916 /loss/FBt4/detection_loss‚2.3833803769789244 &loss/total_loss‚40.971238885501975 /loss/FRt2/assignment_loss‚2.186229262015094 0loss/FRt3/assignment_loss‚3.6411210779960337 0loss/SRqqt4/detection_loss‚2.775478408780209 1loss/FBt2/assignment_loss‚0.04223601139904745 trainer/global_step‚2599 0loss/FRt1/assignment_loss‚1.4203607898492079 0loss/FRt4/assignment_loss‚3.2540080028005165 1loss/FBt1/assignment_loss‚0.13129723844165553 1loss/SRqqt1/detection_loss‚0.8786227841537895 .loss/FBt1/detection_loss‚0.608833106700331 % _timestamp‚1.7884812650559144e+09 _step‚211 /loss/FRt1/detection_loss‚1.6044436907293378 .loss/FRt2/detection_loss‚1.972398205579299 epoch‚4 2loss/SRqqt3/assignment_loss‚1.9509016819167555 2loss/SRqqt4/assignment_loss‚1.4118030804187753 /loss/FRt4/detection_loss‚2.0426759062251905 1loss/SRqqt2/detection_loss‚1.3959343309872425 1loss/FBt3/assignment_loss‚0.18010241065945592 1loss/SRqqt3/detection_loss‚2.5083623737619636 _runtime‚2917.165936964 1loss/SRqqt1/assignment_loss‚0.914889058425628 2loss/SRqqt2/assignment_loss‚1.3349230975235025 0loss/FBt4/assignment_loss‚0.5668438407012314 /loss/FRt3/detection_loss‚3.1971305115864825 /loss/FBt2/detection_loss‚2.2241942032295117ódØ‹cþÝ 0loss/FRt3/assignment_loss‚3.6411210779960337 0loss/SRqqt4/detection_loss‚2.775478408780209 1loss/FBt2/assignment_loss‚0.04223601139904745 trainer/global_step‚2599 0loss/FRt1/assignment_loss‚1.4203607898492079 0loss/FRt4/assignment_loss‚3.2540080028005165 1loss/FBt1/assignment_loss‚0.13129723844165553 1loss/SRqqt1/detection_loss‚0.8786227841537895 .loss/FBt1/detection_loss‚0.608833106700331 % _timestamp‚1.7884812650559144e+09 _step‚211 /loss/FRt1/detection_loss‚1.6044436907293378 .loss/FRt2/detection_loss‚1.972398205579299 epoch‚4 2loss/SRqqt3/assignment_loss‚1.9509016819167555 2loss/SRqqt4/assignment_loss‚1.4118030804187753 /loss/FRt4/detection_loss‚2.0426759062251905 1loss/SRqqt2/detection_loss‚1.3959343309872425 1loss/FBt3/assignment_loss‚0.18010241065945592 1loss/SRqqt3/detection_loss‚2.5083623737619636 _runtime‚2917.165936964 1loss/SRqqt1/assignment_loss‚0.914889058425628 2loss/SRqqt2/assignment_loss‚1.3349230975235025 0loss/FBt4/assignment_loss‚0.5668438407012314 /loss/FRt3/detection_loss‚3.1971305115864825 /loss/FBt2/detection_loss‚2.2241942032295117 /loss/FBt3/detection_loss‚2.3450694346427916 /loss/FBt4/detection_loss‚2.3833803769789244 &loss/total_loss‚40.971238885501975 /loss/FRt2/assignment_loss‚2.186229262015094Ó|‹ç›ÿ‚(: øèÔúôÜ« gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚219.96' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚54.99000000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0P…µÒQ€‚(:Æ øèԭ㻬 disk.sda.in‚ 57.765625 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.sda2.out‚ 340.3984375* proc.memory.percent‚18.837380409240723% disk./.usageGB‚2976.0947875976562 disk.nvme1n1.out‚ 14710.625 disk.sdb2.out‚ 340.3984375 disk.md0.out‚ 328.06640625# disk.nvme0n1.out‚22251.64453125 disk.rbd0.in‚0( proc.memory.availableMB‚ 2630.5078125 disk.sdb1.out‚0 disk.sda.out‚ 340.3984375# proc.memory.rssMB‚ 3086.31640625 proc.cpu.threads‚17 network.sent‚ 5.500399e+06 disk.sdb.in‚9.4375 disk.md0p1.out‚ 328.06640625 disk.rbd0.out‚ 0.55859375 disk.dm-0.out‚36962.26953125) disk./.usagePercent‚83.21285585366653 disk.sdb1.in‚0 disk.sda2.in‚ 57.765625 disk.rbd2.in‚0$ memory_percent‚83.94465446472168 cpu‚25.715309350929868 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 disk.rbd2.out‚ 0.55859375 network.recv‚969641 disk.sda1.out‚0 disk.sdb.out‚ 340.3984375 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875׈ÏZ‘‚(:† ‡žèÔ•’Ú© gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚123.712' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.928 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0†t–/d‚‚(:Ù ‡žèÔ­õت# proc.memory.rssMB‚ 3086.31640625* proc.memory.percent‚18.837380409240723 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.8671875 network.recv‚975233) disk./.usagePercent‚83.22590129002927 disk.sdb2.in‚9.4375! disk.sda2.out‚342.35302734375 disk.rbd2.out‚ 0.55859375) proc.memory.availableMB‚ 2630.75390625! disk.sdb2.out‚342.35302734375 disk.rbd0.in‚0 disk.sda1.in‚0 disk.sdb.out‚342.35302734375 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 329.94140625 disk.sdb1.in‚0 disk.sda.in‚ 57.765625 disk.sdb.in‚9.4375% disk./.usageGB‚2976.5613555908203 disk.sda1.out‚0 disk.md0.out‚ 329.94140625 disk.sdb1.out‚0 disk.sda.out‚342.35302734375 cpu‚25.71417245059347 proc.cpu.threads‚17 disk.sda2.in‚ 57.765625 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚37199.37109375# disk.nvme0n1.out‚22488.66796875 network.sent‚ 5.574765e+06 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 0.55859375 disk.nvme1n1.in‚ 32.45703125! disk.nvme1n1.out‚ 14710.703125$ memory_percent‚83.94315242767334|cæ=•ƒ‚(:Š –žèÔŸ¼Œ« gpu.0.gpu‚80.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚212.105' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.02625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÏóÅB„‚(:· –žèÔ´‚Œ¬% disk./.usageGB‚2976.5612983703613 disk.sdb.out‚ 343.97265625 disk.rbd0.in‚0 disk.nvme0n1.in‚ 220.8671875" disk.nvme1n1.out‚ 14710.9140625 disk.sdb.in‚9.4375 network.recv‚978852 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda.out‚ 343.97265625* proc.memory.percent‚18.837380409240723 disk.rbd0.out‚ 0.55859375 disk.sda1.out‚0 proc.cpu.threads‚17) disk./.usagePercent‚83.22589969012128 disk.sda.in‚ 57.765625# proc.memory.rssMB‚ 3086.31640625 cpu‚25.712906031295613 disk.nvme1n1.in‚ 32.45703125 disk.sda2.out‚ 343.97265625 disk.md0.in‚ 67.203125 disk.rbd2.in‚0 network.sent‚ 5.58211e+06 disk.sdb2.out‚ 343.97265625 disk.md0.out‚ 331.4921875 disk.md0p1.out‚ 331.4921875 disk.dm-0.out‚ 37243.9140625 disk.rbd2.out‚ 0.55859375 disk.sda1.in‚0 proc.memory.availableMB‚2631 disk.nvme0n1.out‚22533 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125" memory_percent‚83.941650390625ÈÔÉ2…- _wandbruntime‚2967  _runtime‚2967¸v§Å†¿ & lr-AdamW/pg1‚0.0008249247442012976 & lr-AdamW/pg2‚0.0008249247442012976 trainer/global_step‚2649 $ _timestamp‚1.788481315022559e+09 _runtime‚ 2967.13300237 _step‚212/Ž—‚Ê‡Ä & lr-AdamW/pg1‚0.0008249247442012976 & lr-AdamW/pg2‚0.0008249247442012976 trainer/global_step‚2649 $ _timestamp‚1.788481315022559e+09 _runtime‚ 2967.13300237 _step‚212Ô•<˜·2ˆ- _wandbruntime‚2967  _runtime‚2967!)·‰ëO N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚47908668 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 trainer/global_step‚2649 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2906354575360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚58690534 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚13779172 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚356927792524304 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚58690534 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2905571098624 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚315094537150464 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13779691 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚315094720198656 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚356927775484944 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2896600323806 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚47908670 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3150440713216 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚359823594326866 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚213 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚366007225568256 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚311944096437248 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2895818841922 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚366007225568256 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚363100853953536 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚363100853953536 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚359824392848110 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚58713806 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚366006425052160 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.Üå=áall.current‚ 798521244 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _runtime‚2967.136780477 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2905571098624 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚522 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 106599202 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚363100870992896 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 $ _timestamp‚1.788481315026298e+09 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚43582176 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚47908670 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚311944121340928 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚47908668 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚29803007 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚315094537150464 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚13779691 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚315094720198656 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚356927775484944 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2896600323806 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚47908670 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3150440713216 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚359823594326866 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚213 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚366007225568256 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚311944096437248 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2895818841922 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚366007225568256 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚363100853953536 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚363100853953536 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚359824392848110 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚58713806 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚366006425052160 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _runtime‚2967.136780477 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2905571098624 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚522 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 106599202 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚363100870992896 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 $ _timestamp‚1.788481315026298e+09 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚43582176 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚47908670 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚311944121340928 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚47908668 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚29803007 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 trainer/global_step‚2649 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2906354575360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚58690534 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚13779172ÕáKý2‹- _wandbruntime‚2967  _runtime‚2967\×Àû&ŒõM ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚363233622304768 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚58735520 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2896881587248 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 % _timestamp‚1.7884813158690324e+09 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 106661642 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚516 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚43597855 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3151600742400 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚359955307273232 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2907420927488 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚315210019823104 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2906637437440 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚58735520 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚43598371 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚357058425685984 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚315209840982528 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 106638342 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2907420927488 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 _runtime‚ 2967.98001999 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚58712222 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚363233622304768 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚47926122 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚363233605265408 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚13784604 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚312058265143808 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚359956105794684 _step‚214 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚47926120 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2897663069340 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 åIÙúM NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚58712222 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚357058442725344 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 trainer/global_step‚2649 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 106661642 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚366141043232256 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚47926122 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚363233605265408 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚13784604 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚312058265143808 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚359956105794684 _step‚214 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚47926120 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2897663069340 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚363233622304768 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚58735520 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 2896881587248 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 % _timestamp‚1.7884813158690324e+09 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 106661642 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚516 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚43597855 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3151600742400 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚359955307273232 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 2907420927488 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚315210019823104 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 2906637437440 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚58735520 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚43598371 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚357058425685984 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚315209840982528 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 106638342 YGDeviceStatsMonitor.on_train_batch_end/actiãN've_bytes.small_pool.allocated‚ 2907420927488 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 _runtime‚ 2967.98001999 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚58712222 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚363233622304768 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 B—‘û•‘‚(:Š ¥žèÔ»’ª gpu.0.gpu‚48.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚229.155' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.28875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0kØ òY’‚(:Î ¥žèÔçãĪ disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375 disk.md0p1.in‚ 67.203125 network.sent‚ 5.586522e+06$ disk./.usageGB‚2976.566207885742 disk.sda.in‚ 57.765625! disk.sdb2.out‚345.48779296875 disk.sda2.in‚ 57.765625! disk.sda2.out‚345.48779296875 disk.rbd0.in‚0 disk.rbd2.in‚0 network.recv‚983806 disk.sdb1.out‚0 disk.sda.out‚345.48779296875 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚14711.04296875 disk.dm-0.out‚ 37379.265625* proc.memory.percent‚18.837380409240723 cpu‚25.71187163678628) disk./.usagePercent‚83.22603696222613 disk.sdb1.in‚0 disk.sda1.out‚0 disk.md0.in‚ 67.203125 disk.md0p1.out‚332.9375 disk.rbd2.out‚ 0.55859375# disk.nvme0n1.out‚22668.22265625 disk.sdb.out‚345.48779296875 disk.md0.out‚332.9375 disk.dm-0.in‚ 253.32421875$ memory_percent‚83.94231796264648 disk.sdb2.in‚9.4375 proc.cpu.threads‚17 disk.rbd0.out‚ 0.55859375' proc.memory.availableMB‚ 2630.890625# proc.memory.rssMB‚ 3086.31640625µT^-‘“‚(:† ´žèÔÖ‹ˆ« gpu.0.gpu‚55.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚209.32' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.33 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0W¢Y”‚(:Î ´žèÔÄ‚Š¬ network.sent‚ 5.674464e+06$ disk./.usageGB‚2976.038833618164 disk.sdb1.out‚0 disk.sda2.in‚ 57.765625$ memory_percent‚83.94222259521484* proc.memory.percent‚18.837380409240723 proc.cpu.threads‚17 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 0.55859375 disk.sda.in‚ 57.765625 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375 disk.rbd0.out‚ 0.55859375 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 334.890625 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚347.5107421875 disk.md0.out‚ 334.890625# proc.memory.rssMB‚ 3086.31640625) disk./.usagePercent‚83.21129135698136 disk.sda.out‚347.5107421875 disk.sdb2.in‚9.4375 disk.sda2.out‚347.5107421875& proc.memory.availableMB‚ 2630.90625 cpu‚25.71087515481636 network.recv‚988267 disk.rbd0.in‚0 disk.dm-0.out‚37552.80859375 disk.sdb1.in‚0 disk.sda1.out‚0# disk.nvme1n1.out‚14711.23828125 disk.sdb2.out‚347.5107421875 disk.md0.in‚ 67.203125 disk.rbd2.in‚0" disk.nvme0n1.out‚ 22841.5703125"t²ž•‚(:“ ÞèÔçÌ« gpu.0.gpu‚16.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚200.023' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚50.005750000000006 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0L©fb–‚(:× ÞèÔîÚÞ¬ cpu‚25.709739552704903) disk./.usagePercent‚83.21828594135684 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.sda.out‚349.09619140625 disk.sdb2.in‚9.4375 disk.sda2.in‚ 57.765625$ memory_percent‚83.94370079040527 network.recv‚991888 disk.md0p1.in‚ 67.203125# disk.nvme0n1.out‚22962.25390625 disk.dm-0.out‚37673.59765625 disk.rbd2.in‚0 disk.sda1.out‚0 disk.sdb.in‚9.4375 disk.sdb.out‚349.09619140625 disk.md0.out‚ 336.41015625* proc.memory.percent‚18.837380409240723 disk.nvme0n1.in‚ 220.8671875! disk.sdb2.out‚349.09619140625 proc.cpu.threads‚17 disk.sda.in‚ 57.765625! disk.sda2.out‚349.09619140625( proc.memory.availableMB‚ 2630.6640625 disk.md0p1.out‚ 336.41015625 disk.rbd2.out‚ 0.55859375 disk.sdb1.in‚0 disk.nvme1n1.out‚ 14711.34375 disk.md0.in‚ 67.203125# proc.memory.rssMB‚ 3086.31640625$ disk./.usageGB‚2976.288993835449 disk.sdb1.out‚0 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 network.sent‚ 5.677754e+06 disk.rbd0.out‚ 0.55859375æ«Ÿ—‚(:” ÒžèÔòÜùª gpu.0.gpu‚46.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‰ ¯Q˜‚(:Æ ÒžèÔ§Ÿê« disk.nvme0n1.out‚23107! disk.nvme1n1.out‚ 14788.578125 disk.sda2.in‚ 57.765625 disk.sda2.out‚ 350.423828125 network.sent‚ 5.685203e+06 disk.md0p1.out‚ 337.68359375 disk.dm-0.out‚ 37895.578125 disk.md0.in‚ 67.203125$ memory_percent‚85.73272228240967 disk.rbd2.in‚0 disk.sdb1.out‚0) proc.memory.availableMB‚ 2337.55078125# proc.memory.rssMB‚ 3086.31640625* proc.memory.percent‚18.837380409240723% disk./.usageGB‚2976.5648155212402 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.32421875 cpu‚25.70847842549269 proc.cpu.threads‚17 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚ 350.423828125 disk.sdb2.in‚9.4375 network.recv‚995796) disk./.usagePercent‚83.22599803113191 disk.md0p1.in‚ 67.203125 disk.sda.out‚ 350.423828125 disk.sdb1.in‚0 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.in‚9.4375 disk.sdb2.out‚ 350.423828125 disk.md0.out‚ 337.68359375 disk.rbd0.in‚0 disk.rbd2.out‚ 0.55859375 disk.sda.in‚ 57.765625úMìú2™- _wandbruntime‚3019  _runtime‚3019*ÁUýÇšÁ trainer/global_step‚2699 % _timestamp‚1.7884813670631993e+09 _runtime‚3019.174950741 _step‚216 & lr-AdamW/pg1‚0.0008088399509637525 & lr-AdamW/pg2‚0.0008088399509637525¨U…mÌ›Æ & lr-AdamW/pg2‚0.0008088399509637525 trainer/global_step‚2699 % _timestamp‚1.7884813670631993e+09 _runtime‚3019.174950741 _step‚216 & lr-AdamW/pg1‚0.0008088399509637525ØfÔG%2œ- _wandbruntime‚3019  _runtime‚3019Iº[ãò'ìO \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚369738419547136 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚48781270 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚217 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚59778286 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚48781268 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚317651311484928 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2948983280230 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚44371358 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚14029828 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚366409268817174 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚523 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2959699344384 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚59801558 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2949764762114 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚526 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2958915867648 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚369738436586496 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚317651286581248 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚372698135930880 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚372698135930880 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚363460285536944 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚366410067338418 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2958915867648 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚59778286 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 trainer/global_step‚2699 % _timestamp‚1.7884813670642576e+09 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚372697335414784 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚369738419547136 _runtime‚3019.175120722 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2959699344384 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 108582828 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3208207729664 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚48781270 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚320859494310912 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚30341004 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚363460302576304 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚372697335414784 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475æÜ»'÷'žñO E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3208207729664 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚48781270 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚320859494310912 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚30341004 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚363460302576304 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚372697335414784 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚369738419547136 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚48781270 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚217 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚59778286 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚48781268 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚317651311484928 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 2948983280230 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚44371358 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚14029828 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚366409268817174 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚523 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 2959699344384 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1784 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚59801558 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 2949764762114 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚526 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 2958915867648 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚369738436586496 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚317651286581248 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚372698135930880 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚372698135930880 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚363460285536944 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚366410067338418 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 2958915867648 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚59778286 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 trainer/global_step‚2699 % _timestamp‚1.7884813670642576e+09 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚372697335414784 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚369738419547136 _runtime‚3019.175120722 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 2959699344384 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 108582828 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0Ùb'¾2Ÿ- _wandbruntime‚3020  _runtime‚3020ïö)† õM B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚59823272 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚48798722 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚369871187898368 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚369871170859008 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚14034793 ZMDeviceStatsMonitor.on_train_batch_end/ivc•u#nactive_split_bytes.large_pool.current‚24903680 $ _timestamp‚1.788481367944139e+09 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚523 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚59799974 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚372831953594880 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2960765696512 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚44387080 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚317765455287808 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3209350703616 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚363590935737984 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 108598694 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚363590952777344 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚320974781087744 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚366541780284992 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 trainer/global_step‚2699 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚14035313 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚372831153065472 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 108598694 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚366540981763540 _step‚218 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2950827507648 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚44386557 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚48798720 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚320974968316928 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚59823272 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚369871187898368 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 108621994 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚48798720 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚30351764 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162325504 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚317765430384128 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚520 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309ÎNR'¡úM RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 2950827507648 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚44386557 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚48798720 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚320974968316928 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚59823272 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚369871187898368 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 108621994 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚48798720 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚30351764 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162325504 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚317765430384128 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚520 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚59823272 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚48798722 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚369871187898368 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚369871170859008 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚14034793 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 $ _timestamp‚1.788481367944139e+09 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚523 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚59799974 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚372831953594880 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 2960765696512 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚44387080 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚317765455287808 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3209350703616 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚363590935737984 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 108598694 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚363590952777344 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚320974781087744 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚366541780284992 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 trainer/global_step‚2699 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚14035313 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚372831153065472 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 108598694 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚366540981763540 _step‚218Ú&±p²2¢- _wandbruntime‚3020  _runtime‚3020(OÜrU£Ï 2loss/SRqqt4/assignment_loss‚1.5278179775636929 .loss/FBt3/detection_loss‚2.095885937151156 _runtime‚3020.056958175 2loss/SRqqt1/assignment_loss‚0.9863331082151897 1loss/SRqqt3/assignment_loss‚1.576260865670284 /loss/FBt1/detection_loss‚0.7041008496191352 .loss/FBt4/detection_loss‚2.312274712583293 epoch‚4 trainer/global_step‚2699 .loss/FRt3/detection_loss‚2.819385356735438 1loss/SRqqt2/detection_loss‚1.2025181853522857 0loss/FBt4/assignment_loss‚0.5231514328521449 .loss/FBt2/detection_loss‚1.634246902032332 % _timestamp‚1.7884813679469268e+09 _step‚219 0loss/FRt1/assignment_loss‚1.7441758366192088 0loss/FBt2/assignment_loss‚0.2002957665771832 /loss/FRt1/detection_loss‚1.9235752548365033 .loss/FRt4/detection_loss‚2.061981915969023 0loss/FRt3/assignment_loss‚3.4602081179618835 1loss/FBt1/assignment_loss‚0.13403464804664184 1loss/SRqqt1/detection_loss‚1.1298410806304484 %loss/total_loss‚39.76279717181461 /loss/FRt2/detection_loss‚1.9803085473149713 /loss/FRt2/assignment_loss‚2.130681780853657 2loss/SRqqt2/assignment_loss‚1.3541134348760049 /loss/FBt3/assignment_loss‚0.389381634691266 1loss/SRqqt3/detection_loss‚2.6663113865587444 0loss/SRqqt4/detection_loss‚2.139240790788944 .loss/FRt4/assignment_loss‚3.06667164831518Û„Z¤Ô 0loss/FRt1/assignment_loss‚1.7441758366192088 0loss/FBt2/assignment_loss‚0.2002957665771832 /loss/FRt1/detection_loss‚1.9235752548365033 .loss/FRt4/detection_loss‚2.061981915969023 0loss/FRt3/assignment_loss‚3.4602081179618835 1loss/FBt1/assignment_loss‚0.13403464804664184 1loss/SRqqt1/detection_loss‚1.1298410806304484 %loss/total_loss‚39.76279717181461 /loss/FRt2/detection_loss‚1.9803085473149713 /loss/FRt2/assignment_loss‚2.130681780853657 2loss/SRqqt2/assignment_loss‚1.3541134348760049 /loss/FBt3/assignment_loss‚0.389381634691266 1loss/SRqqt3/detection_loss‚2.6663113865587444 0loss/SRqqt4/detection_loss‚2.139240790788944 .loss/FRt4/assignment_loss‚3.06667164831518 2loss/SRqqt4/assignment_loss‚1.5278179775636929 .loss/FBt3/detection_loss‚2.095885937151156 _runtime‚3020.056958175 2loss/SRqqt1/assignment_loss‚0.9863331082151897 1loss/SRqqt3/assignment_loss‚1.576260865670284 /loss/FBt1/detection_loss‚0.7041008496191352 .loss/FBt4/detection_loss‚2.312274712583293 epoch‚4 trainer/global_step‚2699 .loss/FRt3/detection_loss‚2.819385356735438 1loss/SRqqt2/detection_loss‚1.2025181853522857 0loss/FBt4/assignment_loss‚0.5231514328521449 .loss/FBt2/detection_loss‚1.634246902032332 % _timestamp‚1.7884813679469268e+09 _step‚219ÛUŸ²”¥‚(:‰ ážèÔô÷ü« gpu.0.gpu‚63.0 gpu.0.memory‚15, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.966' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.9915 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0y3ýÏ^¦‚(:Ó ážèÔ‘™¬ disk.sdb2.out‚ 352.197265625 disk.md0.out‚ 339.3984375 disk.nvme0n1.in‚ 220.8671875 disk.sda2.in‚ 57.765625 disk.sda2.out‚ 352.197265625 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sda1.in‚0# memory_percent‚85.7332706451416 network.sent‚ 5.702458e+06# disk.nvme0n1.out‚23251.02734375# disk.nvme1n1.out‚14791.16796875 proc.cpu.threads‚17 disk.md0p1.in‚ 67.203125# proc.memory.rssMB‚ 3086.31640625* proc.memory.percent‚18.837380409240723 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 339.3984375 disk.rbd2.in‚0 disk.rbd2.out‚ 0.55859375 disk.sdb.in‚9.4375 disk.sda1.out‚0 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.32421875 disk.sda.out‚ 352.197265625 disk.sdb.out‚ 352.197265625 cpu‚25.70728920845125 network.recv‚ 1.000362e+06) disk./.usagePercent‚83.22691307183699 disk.sda.in‚ 57.765625( proc.memory.availableMB‚ 2337.4609375 disk.sdb2.in‚9.4375 disk.dm-0.out‚ 38042.1953125 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125$ disk./.usageGB‚2976.597541809082¾`Ÿ§‚(:” ðžèÔû‚¸© gpu.0.gpu‚85.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚41.0 gpu.0.powerWatts‚230.204' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚57.550999999999995 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚03=Ûe¨‚(:Ú ðžèÔýÎ¥« disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125 network.recv‚ 1.004853e+06 disk.sda1.in‚0 disk.sdb.out‚354.26318359375 disk.rbd0.in‚0 proc.cpu.threads‚17 disk.sda.in‚ 57.765625# disk.nvme0n1.out‚23395.28515625! disk.sda2.out‚354.26318359375 disk.md0.out‚ 341.390625( proc.memory.availableMB‚ 2337.2109375 cpu‚25.706214797351343! disk.nvme1n1.out‚ 14877.953125 disk.sdb2.in‚9.4375 disk.rbd2.out‚ 0.55859375# proc.memory.rssMB‚ 3086.31640625* proc.memory.percent‚18.837380409240723) disk./.usagePercent‚83.23303826621513! disk.sdb2.out‚354.26318359375 disk.dm-0.out‚38273.23828125$ disk./.usageGB‚2976.816608428955 disk.sda1.out‚0 network.sent‚ 5.777578e+06 disk.sdb1.in‚0 disk.md0p1.out‚ 341.390625 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 0.55859375$ memory_percent‚85.73479652404785 disk.nvme1n1.in‚ 32.45703125 disk.sdb1.out‚0 disk.sda.out‚354.26318359375ZMÖ¿Ÿ©‚(:” ÿžèÔ•«¼« gpu.0.gpu‚39.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0O…]Ãhª‚(:Ý ÿžèÔÔ·­ disk.sdb1.out‚0 disk.sdb.out‚355.87451171875 network.sent‚ 5.781827e+06 disk.rbd0.out‚ 0.55859375 disk.dm-0.in‚ 253.32421875 disk.sda.in‚ 57.765625 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125$ memory_percent‚85.73479652404785 cpu‚25.705023853896623 disk.rbd2.out‚ 0.55859375 disk.sda1.out‚0 proc.cpu.threads‚17 disk.sda1.in‚0# disk.nvme0n1.out‚23531.54296875 disk.nvme1n1.in‚ 32.45703125) disk./.usagePercent‚83.25402265930477$ disk./.usageGB‚2977.567111968994 disk.md0p1.in‚ 67.203125 disk.dm-0.out‚ 38553.90625 disk.sdb1.in‚0 disk.sda.out‚355.87451171875! disk.sda2.out‚355.87451171875* proc.memory.percent‚18.837380409240723 disk.md0p1.out‚ 342.93359375 disk.rbd0.in‚0( proc.memory.availableMB‚ 2337.2109375 disk.rbd2.in‚0# disk.nvme1n1.out‚15022.36328125 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375 network.recv‚ 1.009672e+06 disk.nvme0n1.in‚ 220.8671875! disk.sdb2.out‚355.87451171875 disk.md0.out‚ 342.93359375# proc.memory.rssMB‚ 3086.31640625ë—[H2«- _wandbruntime‚3072  _runtime‚3072OÏ%*ǬÁ _runtime‚3072.944240641 _step‚220 & lr-AdamW/pg1‚0.0007925792159696921 & lr-AdamW/pg2‚0.0007925792159696921 trainer/global_step‚2749 % _timestamp‚1.7884814208339384e+09˜‘˜;Ì­Æ & lr-AdamW/pg1‚0.0007925792159696921 & lr-AdamW/pg2‚0.0007925792159696921 trainer/global_step‚2749 % _timestamp‚1.7884814208339384e+09 _runtime‚3072.944240641 _step‚220Üwð—2®- _wandbruntime‚3072  _runtime‚3072_Ž8‹F¯ìO GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚49653868 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚326624469621760 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 110543180 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚323358476725248 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚376376002180096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚45160714 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚326624642184192 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚372994943307482 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚379389046293504 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚323358501628928 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚379388245777408 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3013044113408 60DeviceStatsMonitor.Y ¬on_train_batch_start/num_ooms‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚369992812628304 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚60866038 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚376375985140736 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3265992896512 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚60889310 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚49653868 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3013044113408 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚376375985140736 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚30879004 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147658752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚45161220 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚369992795588944 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚379389046293504 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚3072.945705248 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0¿CÜë÷'°ñO ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚45161220 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚369992795588944 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚379389046293504 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚3072.945705248 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1784 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚49653868 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚326624469621760 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 110543180 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚323358476725248 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚376376002180096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚45160714 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚326624642184192 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚372994943307482 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚379389046293504 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚323358501628928 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚379388245777408 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3013044113408 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚369992812628304 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚60866038 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚376375985140736 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3265992896512 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚60889310 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚49653868 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 996147200 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3013044113408 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚376375985140736 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚30879004 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147658752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0ÝF‚Ù2±- _wandbruntime‚3074  _runtime‚3074Ã}Ðeü&²öM cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚323472645431808 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚504 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚323472620528128 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 110559046 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚49671322 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚60911024 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚376508736452608 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25794969600 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚45176350 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3267155335680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚60911024 _runtime‚3074.023187541 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚379522863957504 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 110582346 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚373126656253848 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚49671322 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3267307175424 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚370123462829344 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3013326975488 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚30889764 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚49671320 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚379522063428096 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚379522863957504 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚370123445789984 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 110559046 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚45176350 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3267155335680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚60911024 _runtime‚3074.023187541 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚379522863957504 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 110582346 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚373126656253848 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚49671322 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3267307175424 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚370123462829344 EÊmõ=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3013326975488 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚30889764 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚49671320 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚379522063428096 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚379522863957504 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚370123445789984 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 110559046 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 EDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 $ _timestamp‚1.788481476208778e+09 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚332389862160896 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3066388882432 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚332390041014784 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚61977062 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3065605405696 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚50526470 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚61977062 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚528 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 trainer/global_step‚2799 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚329065666869248 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _step‚225 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚376525322680304 _runtime‚3128.319506116 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 112480258 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚383013567773696 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3066388882432 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚61953790 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚383013550734336 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚376525305640944 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚383013550734336 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚379580617797790 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚386079156140032 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚14532479 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3324195291648 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚386079156140032 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚386079956656128 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚50526468 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3065605405696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 112503532 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚383013550734336 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚379580617797790 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚386079156140032 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚475 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚14532479 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3324195291648 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 996147200 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚386079156140032 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚386079956656128 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚50526468 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3065605405696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 112503532 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 $ _timestamp‚1.788481476208778e+09áöîòÚ2Å- _wandbruntime‚3129  _runtime‚3129=}ox¥ÆöM H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 112542698 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 112519398 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚14537900 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batc´ÏÁW$h_end/allocation.small_pool.peak‚28166 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚383146319085568 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3066671744512 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚332505169330688 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3325358658560 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚61975478 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚45965145 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3067455234560 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚383146319085568 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚50543920 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚522 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _step‚226 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚383146302046208 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚329179835575808 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚329179810672128 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 112542698 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚376655972881344 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚50543922 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3067455234560 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3056374902172 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚332505346074112 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 trainer/global_step‚2799 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚386213774320128 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚31427764 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚383146319085568 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3066671744512 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚332505169330688 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3325358658560 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚61975478 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚45965145 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3067455234560 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚383146319085568 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚50543920 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚522 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _step‚226 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚383146302046208 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚329179835575808 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚329179810672128 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1784 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 112542698 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚376655972881344 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚50543922 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3067455234560 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3056374902172 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚332505346074112 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 trainer/global_step‚2799 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚386213774320128 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚31427764 FDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚51399070 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚338155038087680 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚31955004 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚383057815692944 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚63041542 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚389651116327936 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3109258077038 trainer/global_step‚2849 _runtime‚3184.358608315 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚392770066502656 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚14784174 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚334772881916928 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚63041542 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736Ky¹\÷'ØñO F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚51399070 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚338155038087680 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚31955004 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚383057815692944 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚63041542 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚389651116327936 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25794969600 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚475 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3109258077038 trainer/global_step‚2849 _runtime‚3184.358608315 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚392770066502656 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚14784174 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚334772881916928 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚63041542 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 996147200 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚389651133367296 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309å[xR2Ù- _wandbruntime‚3185  _runtime‚3185Hýuü&ÚöM S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚392903884153344 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚392904684682752 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚338270352322048 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚389783867639808 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚46754449 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3110320822572 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 114503050 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 114503050 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚63086528 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3383326602240 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 149742592 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚506 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 _step‚230 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚63063230 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3120016513536 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚338270177675776 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚389783867639808 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚383188465893984 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚389783884679168 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚63086528 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚334887025719808 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚389783884679168 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3383176859648 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3120800003584 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚503 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚51416522 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 % _timestamp‚1.7884815330853446e+09 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 % _timestamp‚1.7884815330853446e+09 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚338270352322048 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚389783867639808 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚46754449 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3110320822572 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25794969600 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 114503050 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 114503050 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚63086528 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3383326602240 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 149742592 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ?6DeviceÀû\àStatsMonitor.on_train_batch_end/num_device_alloc‚1784 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚506 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 _step‚230 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚63063230 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3120016513536 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚338270177675776 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚389783867639808 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚383188465893984 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚389783884679168 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25794969600 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚63086528 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚334887025719808 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚389783884679168 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3383176859648æÇá«2Ü- _wandbruntime‚3185  _runtime‚3185š«CZÝÔ .loss/FRt2/detection_loss‚1.925646730071428 0loss/SRqqt3/detection_loss‚2.647781796315137 trainer/global_step‚2849 epoch‚4 % _timestamp‚1.7884815330878558e+09 1loss/SRqqt2/detection_loss‚1.3674230612262532 1loss/SRqqt4/detection_loss‚2.0619022278753047 0loss/FRt1/assignment_loss‚1.5243558837817266 0loss/FRt3/assignment_loss‚3.5604984145315868 1loss/FBt2/assignment_loss‚0.17359186949071478 /loss/FBt3/assignment_loss‚0.311202144503568 .loss/FRt3/detection_loss‚2.819897338511452 2loss/SRqqt1/assignment_loss‚0.8281334649323474 /loss/FBt3/detection_loss‚2.5270302332937717 1loss/SRqqt1/detection_loss‚0.9651431262115889 /loss/FBt2/detection_loss‚1.9291167384521528 0loss/FRt2/assignment_loss‚1.9379691609314509 0loss/FRt4/assignment_loss‚3.2129651970333524 1loss/SRqqt4/assignment_loss‚1.615556312032835 1loss/FBt1/assignment_loss‚0.16222497247241707 /loss/FRt1/detection_loss‚1.8116269708498494 /loss/FBt1/detection_loss‚0.8180974439266279 .loss/FRt4/detection_loss‚2.303801658586599 /loss/FBt4/detection_loss‚2.6823182764806246 2loss/SRqqt2/assignment_loss‚1.3643051347108903 2loss/SRqqt3/assignment_loss‚1.8773583903105235 %loss/total_loss‚40.75101004751368 _runtime‚ 3185.19787423 _step‚231 0loss/FBt4/assignment_loss‚0.3230635009814777±°{ÿ_ÞÙ 0loss/FRt2/assignment_loss‚1.9379691609314509 0loss/FRt4/assignment_loss‚3.2129651970333524 1loss/SRqqt4/assignment_loss‚1.615556312032835 1loss/FBt1/assignment_loss‚0.16222497247241707 /loss/FRt1/detection_loss‚1.8116269708498494 /loss/FBt1/detection_loss‚0.8180974439266279 .loss/FRt4/detection_loss‚2.303801658586599 /loss/FBt4/detection_loss‚2.6823182764806246 2loss/SRqqt2/assignment_loss‚1.3643051347108903 2loss/SRqqt3/assignment_loss‚1.8773583903105235 %loss/total_loss‚40.75101004751368 _runtime‚ 3185.19787423 _step‚231 0loss/FBt4/assignment_loss‚0.3230635009814777 .loss/FRt2/detection_loss‚1.925646730071428 0loss/SRqqt3/detection_loss‚2.647781796315137 trainer/global_step‚2849 epoch‚4 % _timestamp‚1.7884815330878558e+09 1loss/SRqqt2/detection_loss‚1.3674230612262532 1loss/SRqqt4/detection_loss‚2.0619022278753047 0loss/FRt1/assignment_loss‚1.5243558837817266 0loss/FRt3/assignment_loss‚3.5604984145315868 1loss/FBt2/assignment_loss‚0.17359186949071478 /loss/FBt3/assignment_loss‚0.311202144503568 .loss/FRt3/detection_loss‚2.819897338511452 2loss/SRqqt1/assignment_loss‚0.8281334649323474 /loss/FBt3/detection_loss‚2.5270302332937717 1loss/SRqqt1/detection_loss‚0.9651431262115889 /loss/FBt2/detection_loss‚1.9291167384521528çîc±Ÿß‚(:” † èÔö°ôª gpu.0.gpu‚83.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚217.455' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚54.363749999999996 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ðTÍkà‚(:à † èÔ²Û˜¬ disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375 disk.sdb2.out‚371.7294921875 disk.sda2.out‚371.7294921875 disk.md0p1.out‚ 358.20703125# disk.nvme0n1.out‚24764.25390625 network.sent‚ 6.008215e+06 network.recv‚ 1.048447e+06% disk./.usageGB‚2977.5665168762207 disk.sda.in‚ 57.765625 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875( proc.memory.availableMB‚ 2337.9921875# proc.memory.rssMB‚ 3086.31640625) disk./.usagePercent‚83.25400602026176 disk.sdb.out‚371.7294921875 disk.sda2.in‚ 57.765625 disk.md0.out‚ 358.20703125 disk.rbd0.in‚0 disk.rbd0.out‚ 0.900390625 disk.rbd2.out‚ 0.85009765625 disk.sda.out‚371.7294921875 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚40696.46484375 disk.rbd2.in‚0 disk.md0.in‚ 67.203125 disk.nvme1n1.in‚ 32.45703125" disk.nvme1n1.out‚ 15932.2109375$ memory_percent‚85.73002815246582 proc.cpu.threads‚17* proc.memory.percent‚18.837380409240723 cpu‚25.694692994549765 disk.md0p1.in‚ 67.203125 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda1.in‚0‚Ú]Ô“á‚(:ˆ • èÔíÑ‹« gpu.0.gpu‚61.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚231.996' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‰»O'gâ‚(:Ü • èÔ‹ØÁ« cpu‚25.693881698949845 proc.cpu.threads‚17 disk.nvme0n1.out‚ 24885.5625 disk.rbd2.in‚0$ memory_percent‚85.73160171508789 disk.sdb1.in‚0 disk.sda.out‚373.44189453125 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚373.44189453125 network.sent‚ 6.084938e+06% disk./.usageGB‚2975.9772911071777 disk.sdb1.out‚0 disk.sdb.in‚9.4375! disk.sdb2.out‚373.44189453125 disk.rbd2.out‚ 0.85009765625# proc.memory.rssMB‚ 3086.31640625 disk.sda1.out‚0 disk.sda2.in‚ 57.765625! disk.sda2.out‚373.44189453125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 network.recv‚ 1.054085e+06 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚15980.98828125 disk.md0.in‚ 67.203125 disk.dm-0.out‚40866.55078125 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 0.900390625) disk./.usagePercent‚83.20957060261665 disk.sda.in‚ 57.765625 disk.md0.out‚ 359.859375 disk.sdb2.in‚9.4375 disk.md0p1.out‚ 359.859375' proc.memory.availableMB‚ 2337.734375* proc.memory.percent‚18.837380409240723rzùôã‚(:… ¤ èÔç¼›« gpu.0.gpu‚1.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÐØ_äeä‚(:Ú ¤ èÔÖï´« disk.rbd2.out‚ 0.85009765625 disk.nvme0n1.in‚ 220.8671875$ disk./.usageGB‚2975.927314758301 disk.rbd0.out‚ 0.900390625 disk.md0p1.out‚ 361.3828125* proc.memory.percent‚18.837380409240723 disk.rbd2.in‚0 disk.nvme1n1.in‚ 32.45703125) proc.memory.availableMB‚ 2337.88671875# proc.memory.rssMB‚ 3086.31640625 cpu‚25.693068371235366 disk.dm-0.out‚ 40867.515625! disk.sda2.out‚375.04638671875 proc.cpu.threads‚17 disk.sdb1.in‚0 disk.sda1.in‚0 disk.sdb.in‚9.4375! disk.sdb2.out‚375.04638671875 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 disk.sda.in‚ 57.765625 network.sent‚ 6.087968e+06) disk./.usagePercent‚83.20817324298531 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.sda1.out‚0! disk.nvme0n1.out‚ 24885.703125 disk.sdb.out‚375.04638671875 disk.dm-0.in‚ 253.32421875 disk.nvme1n1.out‚ 15981.8125# memory_percent‚85.7306718826294 disk.sda.out‚375.04638671875 network.recv‚ 1.057527e+06 disk.sdb2.in‚9.4375 disk.sda2.in‚ 57.765625 disk.md0.out‚ 361.3828125«¸Ã:2å- _wandbruntime‚3233  _runtime‚3233q{Åæ¿ _step‚232 & lr-AdamW/pg1‚0.0007428777927519668 & lr-AdamW/pg2‚0.0007428777927519668 trainer/global_step‚2899 # _timestamp‚1.78848158145134e+09 _runtime‚3233.561685761*gšÊçÄ & lr-AdamW/pg1‚0.0007428777927519668 & lr-AdamW/pg2‚0.0007428777927519668 trainer/global_step‚2899 # _timestamp‚1.78848158145134e+09 _runtime‚3233.561685761 _step‚232è)LD2è- _wandbruntime‚3233  _runtime‚3233ˆ9Ãœò'éìO @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884815814524946e+09 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚396288698960896 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚52271670 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚389590342784304 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 116400962 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚396288681921536 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚343919999452672 trainer/global_step‚2899 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚47529550 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚52271670 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚64152566 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚399460976865280 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚396288681921536 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚340480072060928 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚340480047157248 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚64129294 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3439927391744 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3162422515346 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3173078420480 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 116424236 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚15036022 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0¡s¢÷'êñO JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚340480047157248 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1784 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚64129294 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25794969600 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1784 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚475 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3439927391744 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3162422515346 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3173078420480 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 116424236 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚15036022 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884815814524946e+09 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25794969600 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚396288698960896 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚52271670 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚389590342784304 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 116400962 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚396288681921536 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚343919999452672 trainer/global_step‚2899 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚47529550 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚52271670 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚64152566 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚399460976865280 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚396288681921536 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚340480072060928ém6q2ë- _wandbruntime‚3234  _runtime‚3234>” ¬°ìöM E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 trainer/global_step‚2899 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚64174280 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.frea‡áL%ed‚389720975945984 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚399595595045376 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚396421450272768 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3441080904704 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚389720992985344 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚64150982 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚52289120 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15041022 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3163485260880 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 116463402 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚47544786 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚392884478246224 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3174144772608 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚527 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚340594215863808 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3173361282560 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚392883679724772 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚340594190960128 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚52289122 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚32503767 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 116440102 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3173361282560 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3174144772608 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3162703778788 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚475 _runtime‚3234.401541878 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚530 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚64174280 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3440924870656 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚52289120 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚396421450272768 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 116440102 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚52289122 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚399595595045376 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 116463402 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 996147200 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚530 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1784 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚475 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚64174280 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3440924870656 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚475 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚52289120 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚396421450272768 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 116440102 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚52289122 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚399595595045376 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 116463402 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚389720992985344 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 996147200 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚64150982 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚52289120 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15041022 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3163485260880 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 116463402 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚47544786 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚392884478246224 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3174144772608 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚527 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚340594215863808 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1784 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3173361282560 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚392883679724772 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚340594190960128 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1784 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚52289122 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚32503767 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 116440102 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728êñ‘®2î- _wandbruntime‚3234  _runtime‚3234§¦XïÒ 2loss/SRqqt1/assignment_loss‚0.8811137648373842 /loss/FBt1/detection_loss‚0.7206332025281783 1loss/FBt1/assignment_loss‚0.12113910255615948 1loss/FBt2/assignment_loss‚0.10222214903093291 0loss/FBt3/assignment_loss‚0.3705322429537369 .loss/FBt2/detection_loss‚1.447879740879649 /loss/FBt3/detection_loss‚2.4908502101898193 -loss/FBt4/detection_loss‚2.58741574252353 0loss/FRt4/assignment_loss‚3.1953769789097155 .loss/FRt1/detection_loss‚1.645122643981717 _step‚235 2loss/SRqqt4/assignment_loss‚1.8561257678403023 /loss/FRt2/detection_loss‚2.0361458328035145 %loss/total_loss‚40.24245875591984 epoch‚4 trainer/global_step‚2899 _runtime‚3234.403064035 2loss/SRqqt2/assignment_loss‚1.1487248147063902 2loss/SRqqt3/assignment_loss‚1.8186388580844952 .loss/FRt4/detection_loss‚2.157073362079632 1loss/SRqqt1/detection_loss‚1.1257582324892283 $ _timestamp‚1.788481582293041e+09 /loss/FRt2/assignment_loss‚2.079363611009386 0loss/FRt1/assignment_loss‚1.5414847719041924 .loss/FRt3/detection_loss‚3.059653356075287 1loss/SRqqt2/detection_loss‚1.3826469545528082 1loss/SRqqt3/detection_loss‚2.3419465321760913 0loss/SRqqt4/detection_loss‚2.210518431990114 0loss/FBt4/assignment_loss‚0.3583305273123455 0loss/FRt3/assignment_loss‚3.5637619245052337Ã<»ö]ð× /loss/FBt1/detection_loss‚0.7206332025281783 1loss/FBt1/assignment_loss‚0.12113910255615948 1loss/FBt2/assignment_loss‚0.10222214903093291 0loss/FBt3/assignment_loss‚0.3705322429537369 .loss/FBt2/detection_loss‚1.447879740879649 /loss/FBt3/detection_loss‚2.4908502101898193 -loss/FBt4/detection_loss‚2.58741574252353 0loss/FRt4/assignment_loss‚3.1953769789097155 .loss/FRt1/detection_loss‚1.645122643981717 _step‚235 2loss/SRqqt4/assignment_loss‚1.8561257678403023 /loss/FRt2/detection_loss‚2.0361458328035145 %loss/total_loss‚40.24245875591984 epoch‚4 trainer/global_step‚2899 _runtime‚3234.403064035 2loss/SRqqt2/assignment_loss‚1.1487248147063902 2loss/SRqqt3/assignment_loss‚1.8186388580844952 .loss/FRt4/detection_loss‚2.157073362079632 1loss/SRqqt1/detection_loss‚1.1257582324892283 $ _timestamp‚1.788481582293041e+09 /loss/FRt2/assignment_loss‚2.079363611009386 0loss/FRt1/assignment_loss‚1.5414847719041924 .loss/FRt3/detection_loss‚3.059653356075287 1loss/SRqqt2/detection_loss‚1.3826469545528082 1loss/SRqqt3/detection_loss‚2.3419465321760913 0loss/SRqqt4/detection_loss‚2.210518431990114 0loss/FBt4/assignment_loss‚0.3583305273123455 0loss/FRt3/assignment_loss‚3.5637619245052337 2loss/SRqqt1/assignment_loss‚0.8811137648373842ë¹Þ}”“ñ‚(:ˆ ³ èÔ½‹¬ gpu.0.gpu‚82.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚225.476' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.369 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0æY<ünò‚(:ã ³ èÔí¢š¬% disk./.usageGB‚2976.0025177001953 disk.sda.out‚376.97021484375 disk.md0p1.out‚ 363.23046875 disk.rbd0.in‚0) disk./.usagePercent‚83.21027594871558 disk.sdb1.in‚0 disk.sda2.in‚ 57.765625 disk.rbd0.out‚ 0.900390625 disk.rbd2.in‚0 cpu‚25.69217137218973# disk.nvme1n1.out‚16058.95703125! disk.sdb2.out‚376.97021484375* proc.memory.percent‚18.837380409240723 proc.cpu.threads‚17 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125) proc.memory.availableMB‚ 2337.59765625 disk.sda1.out‚0 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 0.85009765625$ memory_percent‚85.73243618011475# proc.memory.rssMB‚ 3086.31640625 disk.sda.in‚ 57.765625 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚24885.77734375! disk.sda2.out‚376.97021484375 disk.md0p1.in‚ 67.203125 network.sent‚ 6.107225e+06 disk.sdb1.out‚0 disk.md0.out‚ 363.23046875 disk.dm-0.out‚ 40944.734375 network.recv‚ 1.061907e+06 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚376.97021484375±UC“ó‚(:ˆ  èԵ߅« gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚40.0 gpu.0.powerWatts‚227.929' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.98225 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚02Dãcô‚(:Ø  èÔýžÑ« disk.nvme0n1.in‚ 220.8671875! disk.nvme1n1.out‚ 16119.296875 disk.sdb.out‚378.3974609375 disk.sda2.out‚378.3974609375 disk.md0.in‚ 67.203125 network.sent‚ 6.180322e+06 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.4375 disk.rbd2.in‚0 disk.sda.in‚ 57.765625 disk.sda.out‚378.3974609375 disk.md0p1.in‚ 67.203125 disk.dm-0.out‚ 41006.6328125% disk./.usageGB‚2975.9435119628906 disk.sda2.in‚ 57.765625 disk.md0p1.out‚ 364.59375 disk.rbd0.out‚ 0.900390625# proc.memory.rssMB‚ 3086.31640625) disk./.usagePercent‚83.20862612360472) proc.memory.availableMB‚ 2337.59765625* proc.memory.percent‚18.837380409240723 disk.dm-0.in‚ 253.32421875 network.recv‚ 1.066572e+06 disk.sda1.out‚0" disk.nvme0n1.out‚ 24887.3359375 disk.sdb2.in‚9.4375 disk.md0.out‚ 364.59375 disk.rbd2.out‚ 0.85009765625$ memory_percent‚85.73243618011475 disk.sdb1.in‚0 disk.sdb1.out‚0 cpu‚25.691228919156472 proc.cpu.threads‚17 disk.sda1.in‚0 disk.sdb2.out‚378.3974609375 disk.rbd0.in‚0\ ㈔õ‚(:‰ Ñ èÔÂĬ gpu.0.gpu‚16.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.672378540039062* gpu.0.memoryAllocatedBytes‚ 26347372544 gpu.0.temp‚42.0 gpu.0.powerWatts‚232.605' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.15125 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ˆÙsvkö‚(:à Ñ èÔüŽ® disk.dm-0.in‚ 253.32421875 cpu‚25.690245500019454 network.sent‚ 6.186168e+06 network.recv‚ 1.070815e+06 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.4375# memory_percent‚85.7309103012085* proc.memory.percent‚18.837380409240723 disk.rbd0.in‚0! disk.nvme0n1.out‚ 24887.390625 disk.sdb.out‚380.00927734375! disk.sdb2.out‚380.00927734375 disk.sda2.in‚ 57.765625 disk.rbd2.out‚ 0.85009765625 disk.sda.in‚ 57.765625 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 366.1328125) proc.memory.availableMB‚ 2337.84765625 disk.md0.out‚ 366.1328125) disk./.usagePercent‚83.21383318412235! disk.sda2.out‚380.00927734375 disk.rbd0.out‚ 0.900390625 disk.rbd2.in‚0 proc.cpu.threads‚17 disk.dm-0.out‚41094.96484375 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875$ disk./.usageGB‚2976.129741668701 disk.sdb1.in‚0 disk.sda.out‚380.00927734375 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125# proc.memory.rssMB‚ 3086.31640625# disk.nvme1n1.out‚16207.57421875ïn¥Ú2÷- _wandbruntime‚3283  _runtime‚3283ê¾ÙÇøÁ & lr-AdamW/pg1‚0.0007260503549555621 & lr-AdamW/pg2‚0.0007260503549555621 trainer/global_step‚2949 % _timestamp‚1.7884816314817445e+09 _runtime‚3283.592193587 _step‚236s uªÌùÆ & lr-AdamW/pg2‚0.0007260503549555621 trainer/global_step‚2949 % _timestamp‚1.7884816314817445e+09 _runtime‚3283.592193587 _step‚236 & lr-AdamW/pg1‚0.0007260503549555621ìmšé¤2ú- _wandbruntime‚3283  _runtime‚3283ëäFÑoûìO QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚48319803 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚399338439789958 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚546 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚396122835796944 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 _runtime‚3283.596111335 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚53144268 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚406152687744000 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚33031004 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚349685065176576 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3214805471770 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚349684888419840 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 % _timestamp‚1.7884816314853768e+09 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚65240318 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚406151887227904 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚15288253 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚402926247515136 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3497651118592 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚53144268 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3215586953654 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚65217046 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚402926264554496 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚402926264554496 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚48319257 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3226423189504 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚33031007 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚346187237301248 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 _step‚237 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 trainer/global_step‚2949§zDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 _step‚237 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 trainer/global_step‚2949 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚48319803 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚399338439789958 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚546 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚396122835796944 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 _runtime‚3283.596111335 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚53144268 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚406152687744000 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚33031004 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚349685065176576 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3214805471770 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚349684888419840 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 % _timestamp‚1.7884816314853768e+09 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚65240318 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚406151887227904 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚15288253 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚402926247515136 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3497651118592 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0í¦h£Á2ý- _wandbruntime‚3284  _runtime‚3284ˆ ‹oû&þõM E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚53161722 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3498962831872 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚396253485997984 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚406286505408000 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚346301406007808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3226706051584 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚33041767 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3215868217096 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚399470152736532 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚65262032 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚403058998827008 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚65238734 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚33041764 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚403058998827008 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚406285704878592 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _runtime‚3284.554451229 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚15293856 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚53161720 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 118400454 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 $ _timestamp‚1.788481632443282e+09 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚346301381104128 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚396253503037344 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚403059015866368 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3227489541632 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚2949 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚403059015866368 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚48335623 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚53161720 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15293312 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3498806797824 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 118400454 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚53161722 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 118423754 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚48335076 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚349800187901952 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚399469354215080 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3226706051584 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 118423754 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚406286505408000 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752˜Ý&v6ÿúM UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3226706051584 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚33041767 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3215868217096 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚399470152736532 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚65262032 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚403058998827008 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚65238734 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚33041764 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚403058998827008 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚406285704878592 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _runtime‚3284.554451229 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚15293856 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚53161720 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 118400454 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 $ _timestamp‚1.788481632443282e+09 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚346301381104128 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚396253503037344 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚403059015866368 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3227489541632 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚2949 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚403059015866368 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚48335623 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚53161720 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15293312 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3498806797824 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 118400454 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚53161722 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 118423754 FÊ tsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚349800368839680 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚48335076 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚349800187901952 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚399469354215080 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3226706051584 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 118423754 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚406286505408000 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚53161722 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3498962831872 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚396253485997984 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚406286505408000 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚346301406007808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408î iƒÿ2€- _wandbruntime‚3284  _runtime‚3284bÔÉã\Ö 2loss/FBt2/assignment_loss‚0.042965168880567714 1loss/SRqqt3/detection_loss‚2.5191824891350487 /loss/FBt1/detection_loss‚0.5485637030215003 /loss/FBt2/detection_loss‚1.6978252168744803 trainer/global_step‚2949 /loss/FRt3/assignment_loss‚3.620753714139911 2loss/SRqqt3/assignment_loss‚1.7009975931861183 1loss/FBt1/assignment_loss‚0.11386687867986893 1loss/FBt3/assignment_loss‚0.18626324996230617 .loss/FBt4/detection_loss‚2.537642753124237 epoch‚4 1loss/FBt4/assignment_loss‚0.14553689712455195 1loss/SRqqt2/detection_loss‚1.2386545124344337 .loss/FBt3/detection_loss‚2.302533695774694 _step‚239 /loss/FRt1/assignment_loss‚1.377800150584149 2loss/SRqqt1/assignment_loss‚1.0260559670717977 2loss/SRqqt2/assignment_loss‚1.1699842893972228 _runtime‚3284.558755269 1loss/SRqqt4/detection_loss‚2.2756065579633864 /loss/FRt3/detection_loss‚2.8493701297303904 0loss/SRqqt1/detection_loss‚1.170370988244933 /loss/FRt4/assignment_loss‚3.319464734714964 2loss/SRqqt4/assignment_loss‚1.6408259843786557 /loss/FRt2/detection_loss‚1.8597992761060596 .loss/FRt4/detection_loss‚2.222595837803016 $ _timestamp‚1.788481632445625e+09 /loss/FRt1/detection_loss‚1.9081193017222549 /loss/FRt2/assignment_loss‚1.857443306181166 &loss/total_loss‚39.332222396235714ç‚ßÇa‚Û /loss/FRt4/assignment_loss‚3.319464734714964 2loss/SRqqt4/assignment_loss‚1.6408259843786557 /loss/FRt2/detection_loss‚1.8597992761060596 .loss/FRt4/detection_loss‚2.222595837803016 $ _timestamp‚1.788481632445625e+09 /loss/FRt1/detection_loss‚1.9081193017222549 /loss/FRt2/assignment_loss‚1.857443306181166 &loss/total_loss‚39.332222396235714 2loss/FBt2/assignment_loss‚0.042965168880567714 1loss/SRqqt3/detection_loss‚2.5191824891350487 /loss/FBt1/detection_loss‚0.5485637030215003 /loss/FBt2/detection_loss‚1.6978252168744803 trainer/global_step‚2949 /loss/FRt3/assignment_loss‚3.620753714139911 2loss/SRqqt3/assignment_loss‚1.7009975931861183 1loss/FBt1/assignment_loss‚0.11386687867986893 1loss/FBt3/assignment_loss‚0.18626324996230617 .loss/FBt4/detection_loss‚2.537642753124237 epoch‚4 1loss/FBt4/assignment_loss‚0.14553689712455195 1loss/SRqqt2/detection_loss‚1.2386545124344337 .loss/FBt3/detection_loss‚2.302533695774694 _step‚239 /loss/FRt1/assignment_loss‚1.377800150584149 2loss/SRqqt1/assignment_loss‚1.0260559670717977 2loss/SRqqt2/assignment_loss‚1.1699842893972228 _runtime‚3284.558755269 1loss/SRqqt4/detection_loss‚2.2756065579633864 /loss/FRt3/detection_loss‚2.8493701297303904 0loss/SRqqt1/detection_loss‚1.170370988244933ïºo:d“ƒ‚(:ˆ à èÔ„¬ø© gpu.0.gpu‚71.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚132.732' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚33.183 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÒÅ*o„‚(:ä à èÔÄŒ¬% disk./.usageGB‚2976.5616912841797 disk.rbd2.in‚0! disk.sdb2.out‚381.83642578125* proc.memory.percent‚18.837380409240723 proc.cpu.threads‚17 disk.md0p1.in‚ 67.203125 disk.rbd2.out‚ 0.85009765625 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚381.83642578125 disk.sdb2.in‚9.4375! disk.sda2.out‚381.83642578125 disk.md0.out‚ 367.89453125) proc.memory.availableMB‚ 2337.60546875 network.sent‚ 6.204202e+06 network.recv‚ 1.074645e+06( disk./.usagePercent‚83.2259106761561 cpu‚25.689268348171122 disk.sda1.out‚0 disk.rbd0.out‚ 0.900390625 disk.sda.out‚381.83642578125 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0 disk.dm-0.out‚ 41365.9765625 disk.sdb1.in‚0 disk.sdb1.out‚0# disk.nvme0n1.out‚24887.55859375# proc.memory.rssMB‚ 3086.31640625 disk.md0p1.out‚ 367.89453125 disk.dm-0.in‚ 253.32421875 disk.sda.in‚ 57.765625# disk.nvme1n1.out‚16478.41796875 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125$ memory_percent‚85.73238849639893ç„,ž•…‚(:Š ï èÔ«µý© gpu.0.gpu‚83.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚128.665' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚32.16625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0WZ¥½n†‚(:ã ï èÔô¬ « disk.sdb1.out‚0 disk.sdb2.in‚9.4375! disk.sdb2.out‚383.41943359375 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.765625 disk.rbd0.out‚ 0.900390625# proc.memory.rssMB‚ 3086.31640625* proc.memory.percent‚18.837380409240723 cpu‚25.688356255312346 proc.cpu.threads‚17 network.sent‚ 6.278381e+06 disk.md0p1.in‚ 67.203125 disk.sda.in‚ 57.765625# disk.nvme1n1.out‚16594.03515625 disk.sdb.out‚383.41943359375( proc.memory.availableMB‚ 2337.7734375 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 369.41015625 disk.sda.out‚383.41943359375 network.recv‚ 1.079944e+06% disk./.usageGB‚2976.5606727600098 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚ 41481.640625 disk.rbd2.out‚ 0.85009765625 disk.sdb1.in‚0 disk.sdb.in‚9.4375# disk.nvme0n1.out‚24887.60546875) disk./.usagePercent‚83.22588219779402! disk.sda2.out‚383.41943359375 disk.md0.out‚ 369.41015625 disk.sda1.in‚0 disk.sda1.out‚0$ memory_percent‚85.73136329650879 disk.rbd0.in‚0äªÖ—œ‡‚(:‘ þ èÔ×ùª gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚220.183' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚55.04574999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0úüŽªcˆ‚(:Ø þ èÔ­ðÈ« disk.sda2.in‚ 57.765625 disk.md0.out‚ 370.91015625 cpu‚25.68765718625506 proc.cpu.threads‚17 disk.rbd2.out‚ 0.85009765625 disk.sda1.in‚0 disk.sdb.in‚9.4375 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 370.91015625 disk.sdb1.in‚0$ memory_percent‚85.73338985443115 disk.rbd2.in‚0 disk.nvme1n1.out‚16802.25 network.sent‚ 6.285823e+06 network.recv‚ 1.083603e+06 disk.sda.in‚ 57.765625 disk.sda.out‚384.9853515625 disk.nvme0n1.in‚ 220.8671875" disk.nvme0n1.out‚ 24887.9140625% disk./.usageGB‚2976.0392417907715 disk.sdb2.in‚9.4375 disk.dm-0.out‚ 41690.1640625) proc.memory.availableMB‚ 2337.44140625 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0# proc.memory.rssMB‚ 3086.31640625* proc.memory.percent‚18.837380409240723( disk./.usagePercent‚83.2113027696583 disk.sdb2.out‚384.9853515625 disk.sda2.out‚384.9853515625 disk.rbd0.out‚ 0.900390625 disk.sdb.out‚384.9853515625dS&E”‰‚(:‰ ¡èÔùÞñ© gpu.0.gpu‚52.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚206.535' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.63375 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0™üá‚eŠ‚(:Ú ¡èÔòãÛª disk.md0p1.in‚ 67.203125 disk.rbd0.in‚0) disk./.usagePercent‚83.21339598260118 disk.md0p1.out‚ 372.5546875 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.out‚ 16923.625 disk.sdb.in‚9.4375$ memory_percent‚85.73472499847412 cpu‚25.68668614507863 disk.md0.out‚ 372.5546875 disk.rbd2.out‚ 0.85009765625 disk.sda.in‚ 57.765625 disk.sda1.in‚0# proc.memory.rssMB‚ 3086.31640625 disk.sdb1.out‚0 disk.sda.out‚386.6962890625 disk.sdb2.in‚9.4375) proc.memory.availableMB‚ 2337.22265625* proc.memory.percent‚18.837380409240723 proc.cpu.threads‚17 disk.sda2.out‚386.6962890625 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125 network.sent‚ 6.290235e+06% disk./.usageGB‚2976.1141052246094 disk.rbd0.out‚ 0.900390625 disk.rbd2.in‚0# disk.nvme0n1.out‚24887.96484375 disk.sdb2.out‚386.6962890625 disk.md0.in‚ 67.203125 disk.sdb1.in‚0 disk.sdb.out‚386.6962890625 network.recv‚ 1.088437e+06 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚41811.58984375 disk.sda2.in‚ 57.765625Ê/¿2‹- _wandbruntime‚3334  _runtime‚3334ÐÖ5ÅŒ¿ _step‚240 % lr-AdamW/pg1‚0.000709116099011146 % lr-AdamW/pg2‚0.000709116099011146 trainer/global_step‚2999 % _timestamp‚1.7884816823596857e+09 _runtime‚3334.473055954 íÌ•ÊÄ % lr-AdamW/pg2‚0.000709116099011146 trainer/global_step‚2999 % _timestamp‚1.7884816823596857e+09 _runtime‚3334.473055954 _step‚240 % lr-AdamW/pg1‚0.000709116099011146ðV¶¤`2Ž- _wandbruntime‚3334  _runtime‚3334mºíÁñ'ëO R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚412842797590528 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚412843598106624 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3278984481792 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚355450027706880 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 _step‚241 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3555600261632 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚409563830148096 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3268751391962 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚412843598106624 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚405923315759022 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚402655345848944 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3278984481792 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚351894452348928 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 120344940 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚530 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚54016868 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚409563813108736 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚66328070 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚412842797590528 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚54016870 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚402655362888304 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3267969910078 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 % _timestamp‚1.7884816823637142e+09 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3279767958528 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚527 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚66328070 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚355450204463616 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚66304798 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚663047980fMñö'ðO 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚409563830148096 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3268751391962 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚412843598106624 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚405923315759022 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚402655345848944 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3278984481792 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚351894452348928 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 120344940 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚530 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚54016868 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚409563813108736 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚66328070 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚412842797590528 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚54016870 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚402655362888304 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3267969910078 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 % _timestamp‚1.7884816823637142e+09 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3279767958528 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚527 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚66328070 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚355450204463616 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚66304798 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚66304798 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚412842797590528 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚412843598106624 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3278984481792 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚355450027706880 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 _step‚241 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3555600261632 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166ñÍöQ2‘- _wandbruntime‚3335  _runtime‚33350ßû”²’óM B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15543999 XJDeviceStatsMonitß(þ@G&or.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚406055028705388 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚66349784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚66326486 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚352008596151808 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 120360806 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚409696564420608 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚412977415770624 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 _step‚242 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚54034322 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚409696581459968 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3556906761216 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3269032655404 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚33579764 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3280834310656 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚66349784 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3280050820608 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3280050820608 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3556750727168 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚406055827226840 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚409696581459968 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚355565321975296 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚54034322 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 120384106 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _runtime‚ 3335.34241672 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚49123763 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚33579767 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3269814137496 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚49124289 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚15544522 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚523 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640¼éÀ¥þ&“øM SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3280834310656 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚355565502913024 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 120384106 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 120360806 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 _step‚242 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚54034322 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚409696581459968 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3556906761216 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3269032655404 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚33579764 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3280834310656 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚66349784 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3280050820608 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3280050820608 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3556750727168 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚406055827226840 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚409696581459968 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚355565321975296 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚54034322 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 120384106 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 _runtime‚ 3335.34241672 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚49123763 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚33579767 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3269814137496 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚49124289 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚15544522 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚523 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15543999 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚406055028705388 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚66349784 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚66326486 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚352008596151808 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 120360806 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚409696564420608 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚412977415770624 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 B&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.5138888955116272 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.22995752096176147 particle/accuracy_4_of_4‚1 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.10000000149011612 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.010202080011367798 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 8 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.41887757182121277 particle/accuracy_3_of_5‚1 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 :"Purity/*FRt1SRqqt2FBt/event_purity‚0.02571684680879116 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5623013973236084 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 * Purity/4FRt*SRqqt*FBt/FRt_purity‚0.125 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5693734288215637 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.6008416414260864 jet/accuracy_6_of_6‚0 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9915130138397217 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8109619617462158 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9907549619674683 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9910476207733154 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5497658848762512 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.013038728386163712 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.5083333253860474 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.02500000037252903 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.20379692316055298 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.47049176692962646 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.24092532694339752 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.02500000037252903 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9803623557090759 particle/accuracy_6_of_7‚1 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 @&Purity/4FRt2SRG®‘ùqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 % _timestamp‚1.7884817463866448e+09 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.41006991267204285 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9995864033699036 9"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.4654437005519867 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9988052845001221 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.01774360053241253 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5803020596504211 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.41985034942626953 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.25113192200660706 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt0SRqqt2FBt/event_purity‚0.1852240413427353 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.022148841992020607 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3986302614212036 jet/accuracy_1_of_6‚1 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.7555555701255798 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017206238582730293 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.27344006299972534 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3515625 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.10000000149011612 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6333333253860474 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9903476238250732 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.22271297872066498 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6428571343421936 particle/accuracy_2_of_3‚1 (particle/accuracy‚0.8527857661247253 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.34083807468414307 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6523476839065552 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9919885993003845 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2825227677822113 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 +particle/sensitivity‚0.3489050567150116 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 particle/accuracy_1_of_4‚1 particle/accuracy_3_of_7‚1 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 7 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.1927686482667923 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.24570845067501068 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1827162802219391 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19353969395160675 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 8"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.498650461435318 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9920512437820435 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.17677412927150726 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 particle/accuracy_7_of_7‚1 * Purity/4FRt*SRqqt0FBt/FRt_purity‚0.125 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 ;"Purity/1FRt1SRqqt1FBt/event_purity‚0.042344506829977036 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.4014153480529785 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.13725489377975464 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 7validation_average_jet_accuracy‚0.43637940287590027 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 +jet/accuracy_3_of_6‚0.17543859779834747 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.47367462515830994 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 *jet/accuracy_1_of_5‚0.9599598050117493 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5740635991096497 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6567972302436829 7 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.4802631437778473 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 _step‚244 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9954017996788025 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.32345443964004517 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22597970068454742 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.22271297872066498 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 *"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.5 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.009984639473259449 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7591303586959839 )loss/val_total_loss‚39.58277045391619 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.004608294926583767 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 *jet/accuracy_2_of_6‚0.5438596606254578 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4614565670490265 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5574143528938293 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.23431310057640076 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.25675883889198303 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.03866404667496681 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.04235450178384781 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 +jet/accuracy_3_of_5‚0.08495976030826569 particle/accuracy_1_of_3‚1 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3515625 particle/accuracy_1_of_6‚1 jet/accuracy_7_of_7‚0 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.12345678359270096 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.6398809552192688 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 6 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.386317640542984 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.19512462615966797 +jet/accuracy_2_of_3‚0.26054418087005615 jet/accuracy_5_of_5‚0 particle/accuracy_6_of_6‚1 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5277777910232544 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2537953853607178 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5155555605888367 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.45589715242385864 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 particle/accuracy_4_of_5‚1 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.43518519401550293 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.4574953615665436 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4676806926727295 9"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.5079492926597595 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.48024940490722656 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 jet/accuracy_5_of_6‚0 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.5175912380218506 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1398809403181076 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2757982015609741 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0014662756584584713 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.15826933085918427 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4743589758872986 particle/accuracy_5_of_5‚1 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.2380952388048172 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 trainer/global_step‚3019 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.4642193615436554 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9974958300590515 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.22155658900737762 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.22857144474983215 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 particle/accuracy_1_of_5‚1 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.45476415753364563 :"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.46961450576782227 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_6‚1 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.0694444477558136 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 + Purity/0FRt3SRqqt1FBt/FBt_purity‚0.9375 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7041210532188416 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 7 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.2294238805770874 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 +jet/accuracy_4_of_6‚0.07894736528396606 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.028741177171468735 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 8"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.572145402431488 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 7 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.3103404939174652 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.18198101222515106 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 jet/accuracy_4_of_7‚0 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24294249713420868 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4474637806415558 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7675438523292542 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.23550726473331451 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5925976037979126 9"Purity/0FRt1SRqqt*FBt/event_purity‚0.3807612657546997 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9583333134651184 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 particle/accuracy_2_of_5‚1 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.23972804844379425 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.23440122604370117 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.9094650745391846 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.12006838619709015 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9908624291419983 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 )jet/accuracy_2_of_4‚0.404845267534256 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.21090474724769592 8"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.475658655166626 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 epoch‚4 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.46988803148269653 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4972354471683502 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 +particle/specificity‚0.9460529088973999 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5506739616394043 7 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.9873272180557251 9"Purity/2FRt*SRqqt2FBt/event_purity‚0.0277777798473835 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 8"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.714285671710968 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.02444811351597309 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0022700121626257896 ("Purity/3FRt0SRqqt*FBt/event_purity‚0 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6470588445663452 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9311111569404602 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.23987451195716858 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9979401230812073 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.15484286844730377 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.20057611167430878 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9689620137214661 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.4444444477558136 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9873958230018616 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.45476415753364563 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 particle/accuracy_5_of_7‚1 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.008640552870929241 9"Purity/0FRt0SRqqt3FBt/event_purity‚0.1599999964237213 8"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.513943612575531 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.26569613814353943 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.3125 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9975451231002808 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4659004509449005 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.1915043294429779 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.5043860077857971 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9865552186965942 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979265928268433 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6465417146682739 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2777777910232544 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.6428571343421936 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3813968002796173 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3333333432674408 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5173324346542358 ("Purity/3FRt*SRqqt1FBt/event_purity‚0 *jet/accuracy_1_of_1‚0.4738510847091675 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 _runtime‚3398.500091612 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2664068937301636 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_2_of_4‚1 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 , Purity/1FRt*SRqqt3FBt/FRt_purity‚0.65625 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9930520057678223 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3654317259788513 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5409973859786987 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.15625 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9941310882568359 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3825773298740387 & Purity/0FRt0SRqqt1FBt/FBt_purity‚1 :"Purity/0FRt0SRqqt2FBt/event_purity‚0.32666999101638794 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6198979020118713 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5524827241897583 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 9"Purity/2FRt0SRqqt2FBt/event_purity‚0.0535714291036129 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 ,jet/accuracy_4_of_4‚0.006223219912499189 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 particle/accuracy_4_of_6‚1 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.42307692766189575 particle/accuracy_2_of_7‚1 7 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.1687081903219223 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.4028033912181854 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,jet/accuracy_4_of_5‚0.011827956885099411 particle/accuracy_1_of_2‚1 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9923757910728455 +jet/accuracy_2_of_2‚0.11732680350542068 particle/accuracy_4_of_7‚1 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 +"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.75 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_3‚1 *"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.5 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.042500000447034836 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3061392307281494 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 'particle/f_score‚0.4253556728363037 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5909260511398315 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9229885339736938 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6341035962104797 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 9"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.6333333253860474 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.20443671941757202 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5254918932914734 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.42354732751846313 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9886342287063599 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 particle/accuracy_2_of_6‚1 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.2380952388048172 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.4506262242794037 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 *jet/accuracy_1_of_4‚0.9138204455375671 particle/accuracy_5_of_6‚1 jet/accuracy_1_of_7‚1 jet/accuracy_2_of_7‚0.5 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.10069094598293304 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.9126984477043152 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.6428571343421936 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 7 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.2200256735086441 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1785714328289032 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.14781105518341064 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 9"Purity/*FRt0SRqqt0FBt/event_purity‚0.1909719854593277 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2613028287887573 ("Purity/0FRt0SRqqt1FBt/event_purity‚1 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5357142686843872 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5540066361427307 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.19124338030815125 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9876488447189331 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.004273504484444857 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.12160784006118774 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.2465277910232544 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 jet/accuracy_6_of_7‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9766650795936584 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 :"Purity/2FRt0SRqqt0FBt/event_purity‚0.03203964605927467 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.19758346676826477 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ("Purity/3FRt0SRqqt1FBt/event_purity‚0 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.0694444477558136 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.48663726449012756 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.4021163582801819 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.5160441398620605 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.15833334624767303 +jet/accuracy_3_of_4‚0.06756793707609177 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.27417615056037903 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4243517816066742 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.05795767158269882 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.7619047164916992 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.4192453622817993 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4797840714454651 ("Purity/3FRt*SRqqt*FBt/event_purity‚0 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 *jet/accuracy_1_of_3‚0.8812729716300964 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9903450608253479 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.38687488436698914 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.004608294926583767 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.4050178825855255 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5134408473968506 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3145886957645416 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.31695324182510376 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.3333333432674408 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.48598751425743103 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4528399407863617 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4867585301399231 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 jet/accuracy_5_of_7‚0 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 jet/accuracy_3_of_7‚0 *"Purity/*FRt2SRqqt3FBt/SRqqt_purity‚0.5 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.27020204067230225 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 +jet/accuracy_2_of_5‚0.45312225818634033 particle/accuracy_3_of_4‚1 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.29487180709838867 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.4376983940601349 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 *"Purity/0FRt2SRqqt3FBt/SRqqt_purity‚0.5 6 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.973981499671936 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.3461538553237915 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.4913194477558136 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.4937926232814789 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 7 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.1999874860048294 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4884259104728699 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431¡sIµš541740894 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3626262843608856 + Purity/0FRt3SRqqt*FBt/FBt_purity‚0.9375 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.10919539630413055 particle/accuracy_2_of_2‚1 particle/accuracy_1_of_7‚1 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.47948113083839417 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3901154398918152 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 7 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.2596428692340851 +jet/accuracy_3_of_3‚0.03207932040095329 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt1SRqqt1FBt/event_purity‚0.1200796514749527 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07030743360519409 5 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.97172611951828 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0fô+X{¡Þ§ :"Purity/*FRt0SRqqt*FBt/event_purity‚0.41006991267204285 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9995864033699036 9"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.4654437005519867 7 Purity/1FRt0SRqqt1FBt/FBt_purity‚0.9988052845001221 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.01774360053241253 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5803020596504211 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.41985034942626953 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.25113192200660706 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt0SRqqt2FBt/event_purity‚0.1852240413427353 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.022148841992020607 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3986302614212036 jet/accuracy_1_of_6‚1 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.7555555701255798 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017206238582730293 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.27344006299972534 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3515625 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.10000000149011612 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6333333253860474 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9903476238250732 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.22271297872066498 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6428571343421936 particle/accuracy_2_of_3‚1 (particle/accuracy‚0.8527857661247253 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.34083807468414307 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6523476839065552 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9919885993003845 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2825227677822113 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 +particle/sensitivity‚0.3489050567150116 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 particle/accuracy_1_of_4‚1 particle/accuracy_3_of_7‚1 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 7 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.1927686482667923 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.24570845067501068 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1827162802219391 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19353969395160675 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 8"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.498650461435318 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9920512437820435 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.17677412927150726 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 particle/accuracy_7_of_7‚1 * Purity/4FRt*SRqqt0FBt/FRt_purity‚0.125 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 ;"Purity/1FRt1SRqqt1FBt/event_purity‚0.042344506829977036 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.4014153480529785 ("Purity/2FRt1SRqqt*FBt/event_purity‚0 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.13725489377975464 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 7validation_average_jet_accuracy‚0.43637940287590027 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 +jet/accuracy_3_of_6‚0.17543859779834747 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.47367462515830994 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 *jet/accuracy_1_of_5‚0.9599598050117493 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5740635991096497 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6567972302436829 7 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.4802631437778473 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 _step‚244 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9954017996788025 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.32345443964004517 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22597970068454742 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.22271297872066498 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 *"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.5 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.009984639473259449 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7591303586959839 )loss/val_total_loss‚39.58277045391619 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.004608294926583767 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 *jet/accuracy_2_of_6‚0.5438596606254578 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4614565670490265 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5574143528938293 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.23431310057640076 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.25675883889198303 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.03866404667496681 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.04235450178384781 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 +jet/accuracy_3_of_5‚0.08495976030826569 particle/accuracy_1_of_3‚1 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3515625 particle/accuracy_1_of_6‚1 jet/accuracy_7_of_7‚0 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.12345678359270096 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.6398809552192688 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 6 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.386317640542984 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.19512462615966797 +jet/accuracy_2_of_3‚0.26054418087005615 jet/accuracy_5_of_5‚0 particle/accuracy_6_of_6‚1 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5277777910232544 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2537953853607178 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5155555605888367 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.45589715242385864 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 particle/accuracy_4_of_5‚1 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.43518519401550293 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.4574953615665436 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4676806926727295 9"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.5079492926597595 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.48024940490722656 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 jet/accuracy_5_of_6‚0 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.5175912380218506 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1398809403181076 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2757982015609741 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0014662756584584713 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.15826933085918427 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4743589758872986 particle/accuracy_5_of_5‚1 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.2380952388048172 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 trainer/global_step‚3019 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.4642193615436554 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9974958300590515 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.22155658900737762 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.22857144474983215 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 particle/accuracy_1_of_5‚1 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.45476415753364563 :"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.46961450576782227 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_6‚1 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.0694444477558136 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 + Purity/0FRt3SRqqt1FBt/FBt_purity‚0.9375 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7041210532188416 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 7 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.2294238805770874 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 +jet/accuracy_4_of_6‚0.07894736528396606 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.028741177171468735 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 8"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.572145402431488 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 7 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.3103404939174652 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.18198101222515106 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 jet/accuracy_4_of_7‚0 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24294249713420868 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4474637806415558 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7675438523292542 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.23550726473331451 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5925976037979126 9"Purity/0FRt1SRqqt*FBt/event_purity‚0.3807612657546997 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9583333134651184 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 particle/accuracy_2_of_5‚1 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.23972804844379425 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.23440122604370117 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.9094650745391846 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.12006838619709015 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9908624291419983 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 )jet/accuracy_2_of_4‚0.404845267534256 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.21090474724769592 8"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.475658655166626 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 epoch‚4 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.46988803148269653 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4972354471683502 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 +particle/specificity‚0.9460529088973999 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5506739616394043 7 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.9873272180557251 9"Purity/2FRt*SRqqt2FBt/event_purity‚0.0277777798473835 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 8"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.714285671710968 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.02444811351597309 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0022700121626257896 ("Purity/3FRt0SRqqt*FBt/event_purity‚0 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6470588445663452 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9311111569404602 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.23987451195716858 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9979401230812073 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.15484286844730377 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.20057611167430878 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9689620137214661 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.4444444477558136 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9873958230018616 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.45476415753364563 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 particle/accuracy_5_of_7‚1 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.008640552870929241 9"Purity/0FRt0SRqqt3FBt/event_purity‚0.1599999964237213 8"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.513943612575531 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.26569613814353943 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.3125 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9975451231002808 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4659004509449005 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.1915043294429779 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.5043860077857971 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9865552186965942 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979265928268433 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6465417146682739 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2777777910232544 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.6428571343421936 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3813968002796173 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3333333432674408 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5173324346542358 ("Purity/3FRt*SRqqt1FBt/event_purity‚0 *jet/accuracy_1_of_1‚0.4738510847091675 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 _runtime‚3398.500091612 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2664068937301636 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_2_of_4‚1 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 , Purity/1FRt*SRqqt3FBt/FRt_purity‚0.65625 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9930520057678223 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3654317259788513 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5409973859786987 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.15625 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9941310882568359 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3825773298740387 & Purity/0FRt0SRqqt1FBt/FBt_purity‚1 :"Purity/0FRt0SRqqt2FBt/event_purity‚0.32666999101638794 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6198979020118713 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5524827241897583 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 9"Purity/2FRt0SRqqt2FBt/event_purity‚0.0535714291036129 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 ,jet/accuracy_4_of_4‚0.006223219912499189 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 particle/accuracy_4_of_6‚1 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.42307692766189575 particle/accuracy_2_of_7‚1 7 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.1687081903219223 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.4028033912181854 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,jet/accuracy_4_of_5‚0.011827956885099411 particle/accuracy_1_of_2‚1 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9923757910728455 +jet/accuracy_2_of_2‚0.11732680350542068 particle/accuracy_4_of_7‚1 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 +"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.75 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_3‚1 *"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.5 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.042500000447034836 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3061392307281494 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 'particle/f_score‚0.4253556728363037 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5909260511398315 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9229885339736938 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6341035962104797 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 9"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.6333333253860474 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.20443671941757202 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5254918932914734 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.42354732751846313 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9886342287063599 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 particle/accuracy_2_of_6‚1 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.2380952388048172 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.4506262242794037 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 *jet/accuracy_1_of_4‚0.9138204455375671 particle/accuracy_5_of_6‚1 jet/accuracy_1_of_7‚1 jet/accuracy_2_of_7‚0.5 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.10069094598293304 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.9126984477043152 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.6428571343421936 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 7 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.2200256735086441 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1785714328289032 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.14781105518341064 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 9"Purity/*FRt0SRqqt0FBt/event_purity‚0.1909719854593277 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2613028287887573 ("Purity/0FRt0SRqqt1FBt/event_purity‚1 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5357142686843872 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5540066361427307 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.19124338030815125 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9876488447189331 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.004273504484444857 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.12160784006118774 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.2465277910232544 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 jet/accuracy_6_of_7‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9766650795936584 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 :"Purity/2FRt0SRqqt0FBt/event_purity‚0.03203964605927467 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.19758346676826477 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ("Purity/3FRt0SRqqt1FBt/event_purity‚0 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.0694444477558136 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.48663726449012756 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.4021163582801819 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.5160441398620605 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.15833334624767303 +jet/accuracy_3_of_4‚0.06756793707609177 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.27417615056037903 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4243517816066742 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.05795767158269882 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.7619047164916992 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.4192453622817993 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.4797840714454651 ("Purity/3FRt*SRqqt*FBt/event_purity‚0 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 *jet/accuracy_1_of_3‚0.8812729716300964 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9903450608253479 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.38687488436698914 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.004608294926583767 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.4050178825855255 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5134408473968506 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3145886957645416 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.31695324182510376 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.3333333432674408 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.48598751425743103 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4528399407863617 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4867585301399231 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 jet/accuracy_5_of_7‚0 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 jet/accuracy_3_of_7‚0 *"Purity/*FRt2SRqqt3FBt/SRqqt_purity‚0.5 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.27020204067230225 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 +jet/accuracy_2_of_5‚0.45312225818634033 particle/accuracy_3_of_4‚1 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.29487180709838867 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚ë]UÈ0.4376983940601349 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 *"Purity/0FRt2SRqqt3FBt/SRqqt_purity‚0.5 6 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.973981499671936 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.3461538553237915 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.4913194477558136 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.4937926232814789 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 7 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.1999874860048294 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4884259104728699 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3626262843608856 + Purity/0FRt3SRqqt*FBt/FBt_purity‚0.9375 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.10919539630413055 particle/accuracy_2_of_2‚1 particle/accuracy_1_of_7‚1 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.47948113083839417 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3901154398918152 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 7 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.2596428692340851 +jet/accuracy_3_of_3‚0.03207932040095329 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt1SRqqt1FBt/event_purity‚0.1200796514749527 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07030743360519409 5 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.97172611951828 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 +"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.75 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9311508536338806 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.5138888955116272 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.22995752096176147 particle/accuracy_4_of_4‚1 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.10000000149011612 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.010202080011367798 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 8 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.41887757182121277 particle/accuracy_3_of_5‚1 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 :"Purity/*FRt1SRqqt2FBt/event_purity‚0.02571684680879116 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5623013973236084 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 * Purity/4FRt*SRqqt*FBt/FRt_purity‚0.125 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5693734288215637 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.6008416414260864 jet/accuracy_6_of_6‚0 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9915130138397217 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8109619617462158 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9907549619674683 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9910476207733154 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5497658848762512 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.013038728386163712 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.5083333253860474 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.02500000037252903 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.20379692316055298 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.47049176692962646 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.24092532694339752 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.02500000037252903 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9803623557090759 particle/accuracy_6_of_7‚1 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 % _timestamp‚1.7884817463866448e+09ô¥[9“¢‚(:ˆ Ø¡èÔ¦Ù´ª gpu.0.gpu‚87.0 gpu.0.memory‚22, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚223.968' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.992 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0úÃ?{e£‚(:Ú Ø¡èÔå¤Æª# disk.nvme1n1.out‚17572.76171875 disk.rbd2.in‚0 disk.sda.out‚395.7802734375$ memory_percent‚85.73949337005615 disk.sda2.out‚395.7802734375 disk.rbd0.in‚0 disk.rbd0.out‚ 0.900390625 disk.dm-0.in‚ 253.32421875 disk.sda.in‚ 57.765625 disk.sdb2.in‚9.4375 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 381.328125 disk.md0.out‚ 381.328125) disk./.usagePercent‚83.25400527363801# disk./.usageGB‚2977.56649017334 disk.sda2.in‚ 57.765625 disk.sda1.out‚0 proc.cpu.threads‚17 disk.sda1.in‚0# disk.nvme0n1.out‚26034.79296875) proc.memory.availableMB‚ 2336.44140625 cpu‚25.748727804540902 network.sent‚ 6.399823e+06 disk.sdb.in‚9.4375 disk.sdb2.out‚395.7802734375 disk.rbd2.out‚ 0.91259765625" proc.memory.rssMB‚ 3087.1953125* proc.memory.percent‚18.842744827270508 disk.sdb.out‚395.7802734375 disk.md0p1.in‚ 67.203125 disk.sdb1.in‚0 disk.sdb1.out‚0 network.recv‚ 1.109657e+06 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.out‚ 43607.5546875 disk.nvme0n1.in‚ 220.8671875R tš•¤‚(:Š ç¡èÔÛ¯¡« gpu.0.gpu‚79.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚202.191' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚50.54775 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0hÝúíj¥‚(:ß ç¡èÔ¨³–¬ disk.md0p1.in‚ 67.203125 disk.sda.out‚397.35791015625 disk.sda1.in‚0 disk.sdb.out‚397.35791015625 proc.cpu.threads‚17) disk./.usagePercent‚83.23926126830125 disk.sdb.in‚9.4375! disk.sdb2.out‚397.35791015625 disk.md0.in‚ 67.203125) proc.memory.availableMB‚ 2336.68359375" proc.memory.rssMB‚ 3087.1953125 disk.md0p1.out‚ 382.84765625 disk.dm-0.out‚ 44408.3984375 disk.dm-0.in‚ 253.32421875" disk.nvme0n1.out‚ 26691.5546875* proc.memory.percent‚18.842744827270508 disk.rbd0.out‚ 0.900390625 disk.sdb1.out‚0 disk.nvme1n1.out‚ 17716.84375 disk.sdb2.in‚9.4375 cpu‚25.747550744211416 network.sent‚ 6.502501e+06% disk./.usageGB‚2977.0391731262207 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sdb1.in‚0! disk.sda2.out‚397.35791015625 disk.md0.out‚ 382.84765625 network.recv‚ 1.115164e+06 disk.rbd2.out‚ 0.9365234375 disk.sda1.out‚0 disk.sda2.in‚ 57.765625$ memory_percent‚85.73801517486572 disk.sda.in‚ 57.765625 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125þ£_§•¦‚(:Š ö¡èÔÀô´® gpu.0.gpu‚86.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚137.693' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚34.42325 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 Œi§‚(:Þ ö¡èÔþÓõ± disk.rbd2.out‚ 0.9365234375 disk.sdb1.in‚0 proc.cpu.threads‚17 network.sent‚ 6.509833e+06! disk.sdb2.out‚399.02392578125 disk.dm-0.out‚ 44574.0703125 disk.sdb.in‚9.4375" proc.memory.rssMB‚ 3087.1953125 cpu‚25.74639261981203 disk.sdb2.in‚9.4375! disk.sda2.out‚399.02392578125 disk.dm-0.in‚ 253.32421875 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚26740.93359375 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 384.4453125 disk.sda.out‚399.02392578125# disk.nvme1n1.out‚17833.13671875 disk.sdb.out‚399.02392578125% disk./.usageGB‚2976.9889945983887 disk.md0.in‚ 67.203125 disk.rbd2.in‚0$ memory_percent‚85.73956489562988( proc.memory.availableMB‚ 2336.4296875* proc.memory.percent‚18.842744827270508( disk./.usagePercent‚83.2378582556617 disk.md0.out‚ 384.4453125 disk.md0p1.in‚ 67.203125 disk.rbd0.in‚0 disk.sda.in‚ 57.765625 disk.sda1.in‚0 disk.sda2.in‚ 57.765625 network.recv‚ 1.118575e+06 disk.rbd0.out‚ 0.900390625 disk.sdb1.out‚0Ånm2¨- _wandbruntime‚3435  _runtime‚3435Dzé½ trainer/global_step‚3049 % _timestamp‚1.7884817831814795e+09 _runtime‚3435.291722182 _step‚245 $ lr-AdamW/pg1‚0.00069208916385567 $ lr-AdamW/pg2‚0.00069208916385567£É ÀȪ $ lr-AdamW/pg1‚0.00069208916385567 $ lr-AdamW/pg2‚0.00069208916385567 trainer/global_step‚3049 % _timestamp‚1.7884817831814795e+09 _runtime‚3435.291722182 _step‚245õd²÷'2«- _wandbruntime‚3435  _runtime‚3435@™lñ'¬ëO N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚67677543 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚415195164915012 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚67654271 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚34428725 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚34428722 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3633514916352 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚50352675 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3351903245824 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚411853706542448 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚55302390 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚67677543 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3352686722560 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚359952593148928 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 _runtime‚ 3435.29578653 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚67654271 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚55302390 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚55302388 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚422370268252672 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚419018382046208 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚363586132968960 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚363585947823616 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚246 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 122979933 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚422370268252672 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 122956659 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚55302388 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚15923950 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚359952618052608 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3633354674688 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3352686722560 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚411853723581808 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚419018365006848 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785}ŸBö'­ðO D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚67654271 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚34428725 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚34428722 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3633514916352 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚50352675 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3351903245824 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚411853706542448 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚55302390 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚67677543 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3352686722560 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚359952593148928 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 _runtime‚ 3435.29578653 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚67654271 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚55302390 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚55302388 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚422370268252672 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚419018382046208 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚363586132968960 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚363585947823616 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚246 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 122979933 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚422370268252672 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 122956659 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚55302388 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚15923950 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚359952618052608 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3633354674688 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3352686722560 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚411853723581808 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚419018365006848 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚67677543 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚415195164915012 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272öˆ7üÎ2®- _wandbruntime‚3436  _runtime‚3436Ç^§* ¯õM ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚419151116318720 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚55319840 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚360066736951808 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚50368381 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3352969584640 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_baÎvçýî#tch_end/num_device_alloc‚1785 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚67675959 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3352969584640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚15928896 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 trainer/global_step‚3049 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚34439485 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚50367877 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3634488168448 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚411984356743488 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 166519808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15928395 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚415326079340134 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3341722596646 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚360066761855488 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚34439482 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚422504886432768 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 122995799 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3353753074688 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 123019099 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚419151116318720 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚501 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3353753074688 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚67699257 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚419151133358080 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚415326877861586 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 122995799 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚55319840 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚411984373782848 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚50367877 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3634488168448 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚411984356743488 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 166519808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚15928395 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚415326079340134 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3341722596646 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚360066761855488 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚34439482 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚422504886432768 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 122995799 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3353753074688 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 123019099 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚419151116318720 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚501 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3353753074688 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚67699257 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚419151133358080 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚415326877861586 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 122995799 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚55319840 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚411984373782848 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚50368381 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3352969584640 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚67675959 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3352969584640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚15928896 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 trainer/global_step‚3049 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476÷GÎí2±- _wandbruntime‚3436  _runtime‚3436“ð‰ŽY²Ó 1loss/SRqqt4/assignment_loss‚1.495835246088413 0loss/FRt2/assignment_loss‚2.1593328759449872 .loss/FBt2/detection_loss‚1.412838716237318 /loss/FRt4/assignment_loss‚3.397459529109837 2loss/SRqqt2/assignment_loss‚1.1217667176468955 /loss/FRt2/detection_loss‚1.8884220098873146 trainer/global_step‚3049 % _timestamp‚1.7884817840439801e+09 2loss/SRqqt1/assignment_loss‚0.9774063344707331 1loss/FBt2/assignment_loss‚0.27381820880741325 /loss/FRt3/detection_loss‚2.9264375067526296 0loss/SRqqt4/detection_loss‚2.559422630530137 1loss/SRqqt3/assignment_loss‚1.702199830834208 /loss/FBt1/detection_loss‚0.7392699606926706 epoch‚5 /loss/FRt1/detection_loss‚1.6326153980511608 0loss/FRt1/assignment_loss‚1.6593819784395623 /loss/FRt3/assignment_loss‚3.238517136343064 0loss/SRqqt1/detection_loss‚0.963966344865106 /loss/FRt4/detection_loss‚2.1139446563224222 1loss/SRqqt3/detection_loss‚2.3752259509316804 /loss/FBt3/detection_loss‚2.3380602958955263 %loss/total_loss‚39.64042987200574 _runtime‚ 3436.1540228 _step‚248 /loss/FBt4/detection_loss‚2.6806079512057095 1loss/FBt1/assignment_loss‚0.17390210343845816 0loss/FBt3/assignment_loss‚0.3514102423817492 1loss/FBt4/assignment_loss‚0.27098157410858653 1loss/SRqqt2/detection_loss‚1.1876066730201589Œ[ï^³Ø /loss/FRt4/assignment_loss‚3.397459529109837 2loss/SRqqt2/assignment_loss‚1.1217667176468955 /loss/FRt2/detection_loss‚1.8884220098873146 trainer/global_step‚3049 % _timestamp‚1.7884817840439801e+09 2loss/SRqqt1/assignment_loss‚0.9774063344707331 1loss/FBt2/assignment_loss‚0.27381820880741325 /loss/FRt3/detection_loss‚2.9264375067526296 0loss/SRqqt4/detection_loss‚2.559422630530137 1loss/SRqqt3/assignment_loss‚1.702199830834208 /loss/FBt1/detection_loss‚0.7392699606926706 epoch‚5 /loss/FRt1/detection_loss‚1.6326153980511608 0loss/FRt1/assignment_loss‚1.6593819784395623 /loss/FRt3/assignment_loss‚3.238517136343064 0loss/SRqqt1/detection_loss‚0.963966344865106 /loss/FRt4/detection_loss‚2.1139446563224222 1loss/SRqqt3/detection_loss‚2.3752259509316804 /loss/FBt3/detection_loss‚2.3380602958955263 %loss/total_loss‚39.64042987200574 _runtime‚ 3436.1540228 _step‚248 /loss/FBt4/detection_loss‚2.6806079512057095 1loss/FBt1/assignment_loss‚0.17390210343845816 0loss/FBt3/assignment_loss‚0.3514102423817492 1loss/FBt4/assignment_loss‚0.27098157410858653 1loss/SRqqt2/detection_loss‚1.1876066730201589 1loss/SRqqt4/assignment_loss‚1.495835246088413 0loss/FRt2/assignment_loss‚2.1593328759449872 .loss/FBt2/detection_loss‚1.412838716237318ø¯ÖŒiŸ´‚(:” …¢èÔ¤ÇÓ« gpu.0.gpu‚70.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚225.753' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚56.438250000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÏVÎ/iµ‚(:Þ …¢èÔ‘€Ê¬ disk.sda2.in‚ 57.765625# disk.nvme0n1.out‚26817.99609375! disk.nvme1n1.out‚ 18005.203125 disk.sdb.in‚9.4375! disk.sdb2.out‚400.95361328125$ memory_percent‚85.74128150939941% disk./.usageGB‚2977.0645179748535 disk.rbd0.in‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875( proc.memory.availableMB‚ 2336.1484375 cpu‚25.745199139114508 proc.cpu.threads‚17 disk.dm-0.out‚44823.19921875 network.recv‚ 1.123721e+06! disk.sda2.out‚400.95361328125 disk.md0.out‚ 386.296875 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 0.900390625 disk.sdb1.out‚0 disk.sdb2.in‚9.4375* proc.memory.percent‚18.842744827270508 network.sent‚ 6.527303e+06 disk.sdb1.in‚0 disk.sda.out‚400.95361328125 disk.rbd2.in‚0 disk.rbd2.out‚ 0.99951171875" proc.memory.rssMB‚ 3087.1953125) disk./.usagePercent‚83.23996992087666 disk.md0.in‚ 67.203125 disk.sda.in‚ 57.765625 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚400.95361328125 disk.md0p1.out‚ 386.296875 disk.dm-0.in‚ 253.32421875(z>0œ¶‚(:‘ ”¢èÔÅÚÇ© gpu.0.gpu‚47.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚210.95' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚52.73749999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0B7’‚]·‚(:Ò ”¢èÔäªÉ«( disk./.usagePercent‚83.2417844298491! disk.nvme0n1.out‚ 26849.671875 disk.md0p1.out‚ 387.5859375 disk.rbd0.in‚0 disk.sdb1.out‚0" proc.memory.rssMB‚ 3087.1953125 cpu‚25.744021581987578 network.sent‚ 6.602471e+06 disk.dm-0.in‚ 253.32421875) proc.memory.availableMB‚ 2336.14453125 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125 disk.sdb1.in‚0 disk.sdb.in‚9.4375 disk.rbd0.out‚ 0.900390625 disk.rbd2.out‚ 0.99951171875 disk.sda.out‚ 402.294921875$ memory_percent‚85.74130535125732* proc.memory.percent‚18.842744827270508 network.recv‚ 1.128191e+06 disk.sda1.out‚0 disk.sdb.out‚ 402.294921875 disk.md0.out‚ 387.5859375 disk.sda.in‚ 57.765625 disk.sda2.out‚ 402.294921875 disk.md0p1.in‚ 67.203125% disk./.usageGB‚2977.1294136047363! disk.nvme1n1.out‚ 18125.390625 disk.sdb2.in‚9.4375 disk.sdb2.out‚ 402.294921875 disk.sda2.in‚ 57.765625 disk.dm-0.out‚ 44975.0625 proc.cpu.threads‚17 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.rbd2.in‚0¿;Ä'“¸‚(:ˆ £¢èÔžÍå© gpu.0.gpu‚52.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚118.142' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.5355 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0öÎg_¹‚(:Ô £¢èÔˆ« « disk.sda.out‚403.92431640625 disk.sdb2.in‚9.4375$ memory_percent‚85.74120998382568 disk.md0.out‚ 389.15234375 network.recv‚ 1.132772e+06$ disk./.usageGB‚2977.316619873047 disk.sda1.in‚0 disk.sdb.out‚403.92431640625* proc.memory.percent‚18.842744827270508 network.sent‚ 6.606678e+06 disk.sdb.in‚9.4375! disk.sdb2.out‚403.92431640625 disk.sda2.in‚ 57.765625 disk.rbd0.out‚ 0.900390625 disk.dm-0.out‚45201 cpu‚25.742843259742674 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚18293.46484375 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.md0p1.in‚ 67.203125 disk.rbd2.in‚0) proc.memory.availableMB‚ 2336.16015625) disk./.usagePercent‚83.24701879546299 disk.md0.in‚ 67.203125 disk.dm-0.in‚ 253.32421875 proc.cpu.threads‚17 disk.md0p1.out‚ 389.15234375 disk.nvme1n1.in‚ 32.45703125 disk.sda.in‚ 57.765625 disk.sda1.out‚0! disk.sda2.out‚403.92431640625" proc.memory.rssMB‚ 3087.1953125# disk.nvme0n1.out‚26907.53515625 disk.rbd0.in‚0 disk.rbd2.out‚1.0625”bˆW2º- _wandbruntime‚3489  _runtime‚3489¨UÆ»À & lr-AdamW/pg1‚0.0006749837658068419 & lr-AdamW/pg2‚0.0006749837658068419 trainer/global_step‚3099 $ _timestamp‚1.788481837478778e+09 _runtime‚3489.589116267 _step‚249Â#ë©Ë¼Å & lr-AdamW/pg1‚0.0006749837658068419 & lr-AdamW/pg2‚0.0006749837658068419 trainer/global_step‚3099 $ _timestamp‚1.788481837478778e+09 _runtime‚3489.589116267 _step‚249ùo£âM2½- _wandbruntime‚3489  _runtime‚3489ò¼]PѾëO A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚68742023 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚365659783292928 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 124917011 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚425655930600448 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3394605771512 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚522 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚34966722 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 trainer/global_step‚3099 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚56174990 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3406031491584 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 124940285 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚56174990 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚429061979131392 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚519 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚421780040884076 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚425655947639808 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/alloca»;øi ted_bytes.small_pool.current‚ 783476736 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3393824289628 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚68742023 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚34966725 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3691063917568 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚418386233633808 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚56174988 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚369350847210496 _runtime‚3489.591062226 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚421780839405320 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚429061178615296 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3691215770624 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785½Ðg’ö'¿ðO E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3691215770624 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚68742023 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚365659783292928 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 124917011 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚425655930600448 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3394605771512 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚522 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚34966722 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 trainer/global_step‚3099 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚56174990 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3406031491584 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 124940285 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚56174990 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚429061979131392 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚519 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚421780040884076 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚425655947639808 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3393824289628 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚68742023 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚34966725 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3691063917568 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚418386233633808 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚56174988 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚369350847210496 _runtime‚3489.591062226 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚421780839405320 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚429061178615296 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096ú“©ÒI2À- _wandbruntime‚3490  _runtime‚3490<`}íù&ÁóM J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚68763711 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3407097843712 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚429195796795392 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚365773951999488 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3395668517046 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚429195796795392 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚56192442 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 164422656 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚425788698951680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚68787009 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3394887034954 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚56192440 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚369466128154112 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚16175298 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3406314353664 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚68763711 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚509 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3692201058304 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚51152780 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚34977485 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3406314353664 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚56192440 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 124979451 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3692365480960 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚56192442 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3407097843712 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189326336 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚421912552351894 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚421911753830442 trainer/global_step‚3099 _step‚251 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 124979451 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚51153289 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 _runtime‚3490.626209048 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚425788681912320 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 124956151 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚418516883834848 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚418516866795488 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 " _timestamp‚1.7884818385149e+09 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚425788681912320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 124956151 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚369466317480448 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚425788698951680 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚429194996265984 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 ¯ÔÅœÂøM MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚425788698951680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚68787009 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3394887034954 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚56192440 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚369466128154112 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚16175298 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3406314353664 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚68763711 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚509 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3692201058304 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚51152780 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚34977485 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3406314353664 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚56192440 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 124979451 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3692365480960 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚56192442 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3407097843712 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189326336 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚421912552351894 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚421911753830442 trainer/global_step‚3099 _step‚251 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 124979451 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚51153289 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 _runtime‚3490.626209048 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚425788681912320 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 124956151 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚418516883834848 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚418516866795488 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 " _timestamp‚1.7884818385149e+09 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚425788681912320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 E?DeviceStatsMonitor.on_train_batcR`¨bh_end/active.large_pool.current‚2 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 124956151 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚369466317480448 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚425788698951680 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚429194996265984 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚68763711 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3407097843712 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚429195796795392 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚365773951999488 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3395668517046 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚429195796795392 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚56192442 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 164422656 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476ûçÞK2Ã- _wandbruntime‚3490  _runtime‚3490W4WZÄÔ /loss/FBt3/detection_loss‚2.4412756173507026 1loss/SRqqt3/assignment_loss‚1.680996908648656 % _timestamp‚1.7884818385184352e+09 2loss/SRqqt4/assignment_loss‚1.7216733356596836 0loss/FBt4/assignment_loss‚0.2931024065056926 /loss/FRt4/detection_loss‚2.1154668581256058 _step‚252 /loss/FRt4/assignment_loss‚3.189206144113219 2loss/SRqqt1/assignment_loss‚0.9570834529778267 2loss/SRqqt2/assignment_loss‚1.4706695676093398 1loss/FBt2/assignment_loss‚0.08691717598131962 /loss/FRt1/detection_loss‚1.5466936430051212 /loss/FBt1/detection_loss‚0.7352520648090943 /loss/FBt2/detection_loss‚1.6139858350928487 /loss/FBt4/detection_loss‚2.3651636086759114 /loss/FRt2/detection_loss‚1.9780021892279707 .loss/FRt3/detection_loss‚2.959203535004666 trainer/global_step‚3099 0loss/FBt3/assignment_loss‚0.1790006964010702 1loss/SRqqt1/detection_loss‚0.9564082667347975 /loss/FRt1/assignment_loss‚1.250885139760517 /loss/FRt3/assignment_loss‚3.042715024529842 1loss/FBt1/assignment_loss‚0.12178242147414839 &loss/total_loss‚38.190007827347614 epoch‚5 0loss/FRt2/assignment_loss‚1.8036784497640466 0loss/SRqqt2/detection_loss‚1.160161008388778 _runtime‚ 3490.62866324 1loss/SRqqt3/detection_loss‚2.2523668174560254 0loss/SRqqt4/detection_loss‚2.268317660050733«aÕI_ÅÙ /loss/FRt1/assignment_loss‚1.250885139760517 /loss/FRt3/assignment_loss‚3.042715024529842 1loss/FBt1/assignment_loss‚0.12178242147414839 &loss/total_loss‚38.190007827347614 epoch‚5 0loss/FRt2/assignment_loss‚1.8036784497640466 0loss/SRqqt2/detection_loss‚1.160161008388778 _runtime‚ 3490.62866324 1loss/SRqqt3/detection_loss‚2.2523668174560254 0loss/SRqqt4/detection_loss‚2.268317660050733 /loss/FBt3/detection_loss‚2.4412756173507026 1loss/SRqqt3/assignment_loss‚1.680996908648656 % _timestamp‚1.7884818385184352e+09 2loss/SRqqt4/assignment_loss‚1.7216733356596836 0loss/FBt4/assignment_loss‚0.2931024065056926 /loss/FRt4/detection_loss‚2.1154668581256058 _step‚252 /loss/FRt4/assignment_loss‚3.189206144113219 2loss/SRqqt1/assignment_loss‚0.9570834529778267 2loss/SRqqt2/assignment_loss‚1.4706695676093398 1loss/FBt2/assignment_loss‚0.08691717598131962 /loss/FRt1/detection_loss‚1.5466936430051212 /loss/FBt1/detection_loss‚0.7352520648090943 /loss/FBt2/detection_loss‚1.6139858350928487 /loss/FBt4/detection_loss‚2.3651636086759114 /loss/FRt2/detection_loss‚1.9780021892279707 .loss/FRt3/detection_loss‚2.959203535004666 trainer/global_step‚3099 0loss/FBt3/assignment_loss‚0.1790006964010702 1loss/SRqqt1/detection_loss‚0.9564082667347975ü5 ÏbÆ‚(:× ²¢èÔ¬ó²­$ memory_percent‚85.73999404907227 network.sent‚ 6.611796e+06 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125 disk.sdb1.in‚0 proc.cpu.threads‚17 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375 disk.md0p1.in‚ 67.203125 disk.rbd2.in‚0' proc.memory.availableMB‚ 2336.359375 disk.dm-0.in‚ 253.32421875 network.recv‚ 1.136263e+06 disk.md0.out‚ 391.06640625" proc.memory.rssMB‚ 3087.1953125 disk.sda2.in‚ 57.765625 disk.rbd0.out‚ 0.900390625! disk.sda2.out‚405.89794921875 disk.dm-0.out‚45374.94140625 disk.sda.in‚ 57.765625 disk.sdb1.out‚0) disk./.usagePercent‚83.25401060666464$ disk./.usageGB‚2977.566680908203 disk.sdb.out‚405.89794921875 cpu‚25.74163744959023 disk.nvme0n1.out‚ 27081.21875# disk.nvme1n1.out‚18293.72265625 disk.sdb2.in‚9.4375! disk.sdb2.out‚405.89794921875 disk.md0p1.out‚ 391.06640625 disk.rbd0.in‚0 disk.sda.out‚405.89794921875* proc.memory.percent‚18.842744827270508 disk.sda1.out‚0 disk.rbd2.out‚1.0625ÛZœîÇ‚(:… ²¢èÔ¤”–¬ gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0­‰È•È‚(:Š Á¢èÔ­®¶© gpu.0.gpu‚83.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚234.781' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.69525 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚00Ä‹_É‚(:Ô Á¢èÔÜ‘Áª disk.sda1.out‚0" proc.memory.rssMB‚ 3087.1953125 network.sent‚ 6.701194e+06 disk.sdb1.in‚0 disk.sdb.out‚407.6103515625 disk.sdb2.out‚407.6103515625 disk.sda1.in‚0 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚ 45692.3046875) disk./.usagePercent‚83.25401060666464 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375 network.recv‚ 1.142125e+06 disk.rbd2.in‚0 disk.sda.in‚ 57.765625 disk.sda.out‚407.6103515625 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚27254.44921875 disk.md0.out‚ 392.703125 disk.md0p1.in‚ 67.203125$ disk./.usageGB‚2977.566680908203 disk.rbd2.out‚1.0625 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0) proc.memory.availableMB‚ 2335.83984375* proc.memory.percent‚18.842744827270508 cpu‚25.740588670463303 disk.md0p1.out‚ 392.703125 disk.rbd0.out‚ 0.900390625$ memory_percent‚85.74316501617432 disk.sdb1.out‚0# disk.nvme1n1.out‚18437.85546875 disk.sda2.out‚407.6103515625 disk.md0.in‚ 67.203125 proc.cpu.threads‚17ƒ)õW“Ê‚(:ˆ ТèÔ±»ê© gpu.0.gpu‚36.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚190.386' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚47.5965 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0R(aË‚(:Ö ТèÔÁØΪ disk.sdb2.in‚9.4375 disk.sdb2.out‚409.0869140625 disk.sda2.in‚ 57.765625 disk.dm-0.in‚ 253.32421875 network.sent‚ 6.704283e+06 network.recv‚ 1.146054e+06) disk./.usagePercent‚83.23926660132784 disk.sda.out‚409.0869140625 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.8671875 disk.md0p1.out‚ 394.12109375 disk.rbd0.in‚0* proc.memory.percent‚18.842744827270508$ disk./.usageGB‚2977.039363861084 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125" proc.memory.rssMB‚ 3087.1953125 disk.sdb1.in‚0 disk.sda2.out‚409.0869140625) proc.memory.availableMB‚ 2336.07421875 disk.md0p1.in‚ 67.203125 disk.sda1.out‚0 disk.rbd2.out‚1.0625 disk.sda1.in‚0 disk.sdb.out‚409.0869140625 cpu‚25.739573749396126 proc.cpu.threads‚17 disk.sda.in‚ 57.765625 disk.md0.out‚ 394.12109375 disk.dm-0.out‚45956.73828125# disk.nvme0n1.out‚27374.72265625 disk.rbd2.in‚0 disk.rbd0.out‚ 0.900390625# memory_percent‚85.7417345046997! disk.nvme1n1.out‚ 18582.015625 disk.sdb.in‚9.4375XCŠðÌ‚(:… ߢèÔÒžã© gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0½€QÍ‚(:Æ ߢèÔ•…¬¬ disk.rbd2.in‚0 disk.rbd2.out‚1.0625 disk.md0p1.out‚ 395.51953125 disk.rbd0.in‚0 disk.dm-0.out‚ 46149.4453125 disk.rbd0.out‚ 0.900390625 disk.dm-0.in‚ 253.32421875 disk.nvme1n1.in‚ 32.45703125 disk.sda.out‚ 410.5390625 disk.md0.in‚ 67.203125 disk.md0.out‚ 395.51953125# memory_percent‚85.7386589050293' proc.memory.availableMB‚ 2336.578125 disk.md0p1.in‚ 67.203125 disk.nvme0n1.in‚ 220.8671875" proc.memory.rssMB‚ 3087.1953125 cpu‚25.73847295583052 disk.sdb1.out‚0 network.sent‚ 6.709871e+06 disk.sda.in‚ 57.765625* proc.memory.percent‚18.842744827270508 disk.sda1.out‚0 disk.sdb1.in‚0 network.recv‚ 1.149775e+06) disk./.usagePercent‚83.23925998837485% disk./.usageGB‚2977.0391273498535 disk.sda1.in‚0 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375! disk.nvme1n1.out‚ 18726.078125 disk.sdb2.out‚ 410.5390625 disk.sda2.out‚ 410.5390625 proc.cpu.threads‚17" disk.nvme0n1.out‚ 27423.3671875 disk.sdb.out‚ 410.5390625 disk.sda2.in‚ 57.765625üÈ2@2Î- _wandbruntime‚3543  _runtime‚3543!Á-ÇÏÁ & lr-AdamW/pg1‚0.0006578141866934783 & lr-AdamW/pg2‚0.0006578141866934783 trainer/global_step‚3149 % _timestamp‚1.7884818914947045e+09 _runtime‚3543.605027609 _step‚253œEÌÐÆ & lr-AdamW/pg1‚0.0006578141866934783 & lr-AdamW/pg2‚0.0006578141866934783 trainer/global_step‚3149 % _timestamp‚1.7884818914947045e+09 _runtime‚3543.605027609 _step‚253ýd¸c2Ñ- _wandbruntime‚3543  _runtime‚3543¦?Ígò'ÒìO E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚69853047 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚371366973436928 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3459376260608 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚51924616 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884818914957633e+09 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚432293513233408 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚435752088977920 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚435752889494016 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚435752088977920 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚57047590 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚16419380 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚428366513895628 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚424918743685808 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3447770209820 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚57047590 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚375115748080128 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0“bG÷'ÓñO YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚435752889494016 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚57047590 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚375115748080128 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚69853047 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚371366973436928 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3459376260608 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚51924616 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884818914957633e+09 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚432293513233408 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚435752088977920 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚435752889494016 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚435752088977920 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚57047590 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚16419380 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚428366513895628 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚424918743685808 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3447770209820 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 126939803 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚57065042 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚35515482 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚435886707158016 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚69851463 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚499 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚502 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 % _timestamp‚1.7884818923419693e+09 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚57065042 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚425049393886848 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚435885906628608 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3460442612736 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚51940296 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3749923545088 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3460442612736 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚375231223819776 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚371481142143488 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚371481117239808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 126939803 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚51939794 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚425049376847488 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 _runtime‚3544.452831267 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚57065040 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3459659122688 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696(®'ÖûM C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 trainer/global_step‚3149 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 126939803 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚57065042 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚35515482 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚435886707158016 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚69851463 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚499 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚502 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 % _timestamp‚1.7884818923419693e+09 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚57065042 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚425049393886848 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚435885906628608 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3460442612736 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚51940296 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3749923545088 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3460442612736 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚375231223819776 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚371481142143488 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚371481117239808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 126939803 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚51939794 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚425049376847488 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 _runtime‚3544.452831267 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚57065040 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3459659122688 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _step‚255 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚432426247505920 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚432426264545280 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚69851463 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200ÿ¼e‰2×- _wandbruntime‚3544  _runtime‚35446Cš _ØÙ %loss/total_loss‚37.61055021289089 _runtime‚3544.453843472 2loss/SRqqt1/assignment_loss‚0.9856480575369623 2loss/SRqqt2/assignment_loss‚1.2443939832208508 trainer/global_step‚3149 /loss/FRt4/detection_loss‚2.0425076304491085 /loss/FBt2/detection_loss‚1.1301495658940282 0loss/FRt2/assignment_loss‚1.9030614743630092 2loss/SRqqt3/assignment_loss‚1.6349772088608499 1loss/SRqqt4/detection_loss‚2.4962113339167376 0loss/FRt3/assignment_loss‚2.7526247771281116 2loss/SRqqt4/assignment_loss‚1.4040665552020073 /loss/FRt1/detection_loss‚1.7183603402641086 /loss/FBt1/detection_loss‚0.6217960455251159 0loss/FRt1/assignment_loss‚1.3354293372895982 .loss/FRt4/assignment_loss‚3.05602182696263 1loss/FBt2/assignment_loss‚0.09807711797434775 1loss/SRqqt1/detection_loss‚0.9923708400187584 0loss/SRqqt3/detection_loss‚2.237352228770822 /loss/FBt4/detection_loss‚2.4711566199274624 epoch‚5 _step‚256 1loss/FBt4/assignment_loss‚0.15154666283756477 /loss/FRt3/detection_loss‚3.0682687230829924 % _timestamp‚1.7884818923438141e+09 0loss/FBt1/assignment_loss‚0.1008765884548129 1loss/FBt3/assignment_loss‚0.26202712275767226 /loss/FRt2/detection_loss‚1.8277662670308794 1loss/SRqqt2/detection_loss‚1.2901878461398029 /loss/FBt3/detection_loss‚2.7856720592826605:VëdÙÞ 0loss/FRt3/assignment_loss‚2.7526247771281116 2loss/SRqqt4/assignment_loss‚1.4040665552020073 /loss/FRt1/detection_loss‚1.7183603402641086 /loss/FBt1/detection_loss‚0.6217960455251159 0loss/FRt1/assignment_loss‚1.3354293372895982 .loss/FRt4/assignment_loss‚3.05602182696263 1loss/FBt2/assignment_loss‚0.09807711797434775 1loss/SRqqt1/detection_loss‚0.9923708400187584 0loss/SRqqt3/detection_loss‚2.237352228770822 /loss/FBt4/detection_loss‚2.4711566199274624 epoch‚5 _step‚256 1loss/FBt4/assignment_loss‚0.15154666283756477 /loss/FRt3/detection_loss‚3.0682687230829924 % _timestamp‚1.7884818923438141e+09 0loss/FBt1/assignment_loss‚0.1008765884548129 1loss/FBt3/assignment_loss‚0.26202712275767226 /loss/FRt2/detection_loss‚1.8277662670308794 1loss/SRqqt2/detection_loss‚1.2901878461398029 /loss/FBt3/detection_loss‚2.7856720592826605 %loss/total_loss‚37.61055021289089 _runtime‚3544.453843472 2loss/SRqqt1/assignment_loss‚0.9856480575369623 2loss/SRqqt2/assignment_loss‚1.2443939832208508 trainer/global_step‚3149 /loss/FRt4/detection_loss‚2.0425076304491085 /loss/FBt2/detection_loss‚1.1301495658940282 0loss/FRt2/assignment_loss‚1.9030614743630092 2loss/SRqqt3/assignment_loss‚1.6349772088608499 1loss/SRqqt4/detection_loss‚2.4962113339167376€4ÒTµ•Ú‚(:Š î¢èÔ´ ý« gpu.0.gpu‚82.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚120.927' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.23175 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0SAÒcÛ‚(:Ø î¢èÔƾ³¬! disk.sda2.out‚412.74462890625 disk.rbd0.in‚0 disk.sda.in‚ 57.765625" disk.nvme1n1.out‚ 18858.5390625 disk.sdb.in‚9.4375! disk.sdb2.out‚412.74462890625 proc.cpu.threads‚17 disk.sdb1.in‚0# disk.nvme0n1.out‚27424.20703125* proc.memory.percent‚18.842744827270508 disk.sda2.in‚ 57.765625 disk.md0.out‚ 397.6640625 disk.rbd0.out‚ 0.900390625 disk.sda1.in‚0 disk.sdb2.in‚9.4375" proc.memory.rssMB‚ 3087.1953125 network.sent‚ 6.72776e+06 disk.md0p1.in‚ 67.203125$ memory_percent‚85.73892116546631 cpu‚25.73740643508987 network.recv‚ 1.153491e+06 disk.md0.in‚ 67.203125 disk.nvme0n1.in‚ 220.8671875% disk./.usageGB‚2975.9616928100586 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚46282.74609375 disk.rbd2.in‚0 disk.rbd2.out‚1.0625 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚412.74462890625 disk.md0p1.out‚ 397.6640625 disk.sda1.out‚0) proc.memory.availableMB‚ 2336.53515625( disk./.usagePercent‚83.2091344677008 disk.sda.out‚412.74462890625¶—ΞÜ‚(:“ ý¢èÔÖÿ¸« gpu.0.gpu‚60.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚215.839' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚53.95974999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‚¡ëm]Ý‚(:Ò ý¢èÔ³ûÄ« disk.sda.in‚ 57.765625# disk.nvme0n1.out‚27424.25390625 disk.sda2.in‚ 57.765625( proc.memory.availableMB‚ 2336.0234375 network.sent‚ 6.805868e+06 network.recv‚ 1.166453e+06 disk.sdb.out‚ 414.119140625 disk.dm-0.out‚ 46474.7734375 proc.cpu.threads‚17 disk.sda.out‚ 414.119140625 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb2.in‚9.4375 disk.rbd0.in‚0$ memory_percent‚85.74204444885254" proc.memory.rssMB‚ 3087.1953125 disk.rbd2.in‚0 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125 cpu‚25.73657058784554$ disk./.usageGB‚2975.996509552002 disk.sda2.out‚ 414.119140625 disk.md0p1.in‚ 67.203125 disk.sdb2.out‚ 414.119140625) disk./.usagePercent‚83.21010795837748 disk.rbd2.out‚1.0625 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sdb.in‚9.4375 disk.dm-0.in‚ 253.32421875# disk.nvme1n1.out‚19050.51953125 disk.md0.in‚ 67.203125 disk.md0.out‚ 398.98046875 disk.md0p1.out‚ 398.98046875 disk.rbd0.out‚ 0.900390625* proc.memory.percent‚18.842744827270508‹“Þ‚(:ˆ Œ£èÔŒ·Ž« gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ºMvdß‚(:Ù Œ£èÔùžê«) proc.memory.availableMB‚ 2336.51953125 disk.md0.out‚ 400.3359375 disk.md0p1.out‚ 400.3359375 disk.dm-0.out‚ 46551.6484375 disk.sdb1.out‚0 disk.sda.in‚ 57.765625 disk.sda1.in‚0 disk.rbd2.out‚1.0625 disk.sda.out‚415.53564453125 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚19127.00390625 disk.sdb.out‚415.53564453125 cpu‚25.735724398225912 proc.cpu.threads‚17) disk./.usagePercent‚83.21357815879006$ disk./.usageGB‚2976.120620727539 disk.sda1.out‚0# disk.nvme0n1.out‚27424.64453125" proc.memory.rssMB‚ 3087.1953125 disk.md0p1.in‚ 67.203125 disk.sdb.in‚9.4375 disk.rbd0.in‚0 network.sent‚ 6.81325e+06 disk.sdb2.in‚9.4375 disk.rbd0.out‚ 0.900390625 disk.dm-0.in‚ 253.32421875 disk.sdb1.in‚0! disk.sdb2.out‚415.53564453125! disk.sda2.out‚415.53564453125 disk.md0.in‚ 67.203125* proc.memory.percent‚18.842744827270508 network.recv‚ 1.170145e+06 disk.sda2.in‚ 57.765625 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.8671875$ memory_percent‚85.73901653289795V§2à- _wandbruntime‚3591  _runtime‚3591*¬‚ÇáÁ _runtime‚3591.602447099 _step‚257 & lr-AdamW/pg1‚0.0006405947619311635 & lr-AdamW/pg2‚0.0006405947619311635 trainer/global_step‚3199 % _timestamp‚1.7884819394921658e+09ïY̺ÌâÆ & lr-AdamW/pg1‚0.0006405947619311635 & lr-AdamW/pg2‚0.0006405947619311635 trainer/global_step‚3199 % _timestamp‚1.7884819394921658e+09 _runtime‚3591.602447099 _step‚257{eÏí2ã- _wandbruntime‚3591  _runtime‚3591)äìO 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚57920190 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚16668744 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3511937552896 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚52710945 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 trainer/global_step‚3199 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚70940799 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚36042725 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚442442999340544 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚70940799 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 _step‚258 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 128837715 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚380880884494848 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3806696010240 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3500934648128 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3512721029632 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚438931061787648 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚52711469 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚57920188 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚70917527 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 128860989 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 % _timestamp‚1.7884819394932601e+09 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚438931078827008 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚377074163580928 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3511937552896 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚442442999340544 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚16668223 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚434951389864692 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚442443799856640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚438931078827008 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚57920190 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚16668744 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3511937552896 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚52710945 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 trainer/global_step‚3199 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚70940799 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚36042725 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚442442999340544 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚70940799 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 _step‚258 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 128837715 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚380880884494848 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3806696010240 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3500934648128 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3512721029632 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚438931061787648 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚52711469 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚57920188 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚70917527 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 128860989 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 % _timestamp‚1.7884819394932601e+09 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚438931078827008 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚377074163580928 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3511937552896 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚442442999340544 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚16668223 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚434951389864692 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚442443799856640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚438931078827008 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚530 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3513003891712 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 128876855 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _runtime‚3592.464437479 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3501215911570 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3513787381760 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚57937640 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚377188307383808 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚52726627 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚52727157 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚36053482 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3807691659776 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚16673672 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚380995999043584 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 128900155 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 128876855 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚442577617520640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚57937642 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3513787381760 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚70939215 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚377188332287488 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚380996182078464 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚57937640 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚70939215 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚439063830138880 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚442576816991232 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚57937642 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚527 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚16673145 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3807849790976 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚52726627 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚52727157 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚36053482 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3807691659776 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚16673672 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚380995999043584 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 128900155 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 128876855 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚442577617520640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚57937642 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3513787381760 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚70939215 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚377188332287488 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚380996182078464 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚57937640 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚70939215 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚439063830138880 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚442576816991232 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚57937642 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚527 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚16673145 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3807849790976 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freedqÔ#ó$ ‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚530 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3513003891712 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 128876855 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _runtime‚3592.464437479 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3501215911570 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3513787381760 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚57937640 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚377188307383808 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚441537862876244 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚437983746750448 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3553317604552 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚53498009 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚36580722 _step‚262 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚36580725 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3566065798656 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚58792788 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚449133909703168 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚382781353724928 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3864213232640 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3864373474304 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚16917287 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚72005279 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚530 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3565282321920 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚382781378628608 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚72005279 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 130821341 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JÞ{c÷'÷ñO KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚441537862876244 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚437983746750448 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3553317604552 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚53498009 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚36580722 _step‚262 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚36580725 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3566065798656 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚58792788 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚449133909703168 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚382781353724928 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3864213232640 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3864373474304 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚16917287 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚72005279 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚530 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3565282321920 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚382781378628608 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚72005279 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 130821341 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433†ËWœ2ø- _wandbruntime‚3643  _runtime‚3643ˆ3ñŸùöM L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚438114396951488 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚386761049703424 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚382895497527808 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 130837207 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚58810242 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚36591485 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚382895522431488 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3566348660736 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚449268527883264 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚445701395732480 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚72026967 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 _runtime‚3643.090074863 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚386760872960000 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚53513674 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 _step‚263 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚58810240 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚449267727353856 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚58810242 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚72050265 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚441669575822818 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3554380349878 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3566348660736 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚449268527883264 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚438114413990848 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 130860507 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚58810240 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚441668777301366 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚72050265 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3567132150784 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 130860507 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 trainer/global_step‚3249 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚36591482 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚449267727353856 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚58810242 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚72050265 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚441669575822818 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3554380349878 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3566348660736 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚449268527883264 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚438114413990848 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 130860507 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚58810240 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚441668777301366 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚72050265 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3567132150784 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 130860507 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 trainer/global_step‚3249 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚36591482 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚438114396951488 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚386761049703424 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚382895497527808 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 130837207 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚58810242 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚36591485 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚382895522431488 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3566348660736 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚449268527883264 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚445701395732480 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚72026967 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 _runtime‚3643.090074863 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚386760872960000 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚53513674 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 _step‚263 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚58810240 EDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 % _timestamp‚1.7884820422570317e+09 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚54285852 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚73093031 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚455824820065792 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚54286370 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 132781693 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998™äàh‘244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚455825620581888 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3619410567680 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚392410520754688 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚452206192974848 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚73093031 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚444516273841808 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚59665390 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚448122738845308 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚452206210014208 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚17167130 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _runtime‚3694.367406392 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚452206210014208 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3921976885760 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚388488568772608 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _step‚266 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚455824820065792 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚54286370 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 132781693 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚455825620581888 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3619410567680 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚392410520754688 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚452206192974848 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚73093031 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚444516273841808 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚59665390 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚448122738845308 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚452206210014208 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚17167130 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _runtime‚3694.367406392 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚452206210014208 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3921976885760 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚388488568772608 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _step‚266 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 % _timestamp‚1.7884820422570317e+09Š/L‡2Œ- _wandbruntime‚3695  _runtime‚36956*,]û&õM PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 132820859 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚448255250313126 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚444646924042848 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚37129485 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3619693429760 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚73138017 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚54301605 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 _step‚267 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚73114719 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚444646907003488 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚392525997797376 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3923285221888 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚59682842 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3619693429760 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17172635 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚455959438245888 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚54302120 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚37129482 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚515 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚59682840 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚455958637716480 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚59682842 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3923127090688 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 132797559 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚73138017 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3620476919808 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 132797559 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚59682840 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3620476919808 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3608326270278 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 _runtime‚3695.249432963 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚452338944286720 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚455959438245888 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 _step‚267 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚73114719 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚444646907003488 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚392525997797376 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3923285221888 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚59682842 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3619693429760 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17172635 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚455959438245888 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚54302120 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚37129482 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚515 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚59682840 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚455958637716480 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚59682842 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3923127090688 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 132797559 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚73138017 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3620476919808 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 132797559 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚59682840 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3620476919808 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3608326270278 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 _runtime‚3695.249432963 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚452338944286720 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚455959438245888 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 132820859 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚448255250313126 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚444646924042848 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚37129485 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3619693429760 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚73138017 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚54301605 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309‹[rÕÍ2- _wandbruntime‚3695  _runtime‚3695õYÓ 1loss/SRqqt2/assignment_loss‚1.291175241569678 2loss/SRqqt3/assignment_loss‚1.5997506345784853 1loss/FBt2/assignment_loss‚0.20792915370998344 /loss/FRt2/detection_loss‚2.0734455577292286 /loss/FBt2/detection_loss‚1.7789649302986534 /loss/FBt4/detection_loss‚2.3138491908709207 1loss/SRqqt4/assignment_loss‚1.716006955815644 0loss/SRqqt4/detection_loss‚2.102233627928963 _step‚268 1loss/FBt1/assignment_loss‚0.12889641968228552 trainer/global_step‚3299 /loss/FRt2/assignment_loss‚2.004931031347631 0loss/FRt3/assignment_loss‚3.0932543616870354 2loss/SRqqt1/assignment_loss‚1.0221869994630488 .loss/FRt3/detection_loss‚2.902406252663711 /loss/FBt3/detection_loss‚3.0428036955686717 /loss/FRt1/assignment_loss‚1.576403420418501 0loss/FBt3/assignment_loss‚0.2866193692899077 /loss/FRt4/detection_loss‚2.0530401740655884 0loss/SRqqt1/detection_loss‚1.102589085392776 1loss/SRqqt3/detection_loss‚2.3551784063142445 /loss/FBt1/detection_loss‚0.6429287661373818 _runtime‚3695.250639309 % _timestamp‚1.7884820431404414e+09 0loss/FRt4/assignment_loss‚3.1381356277555787 1loss/SRqqt2/detection_loss‚1.2646958579619725 0loss/FBt4/assignment_loss‚0.3682707399646385 .loss/FRt1/detection_loss‚1.788134778684859 %loss/total_loss‚39.85383027889939 epoch‚5/ ³˜^‘Ø 1loss/SRqqt2/assignment_loss‚1.291175241569678 2loss/SRqqt3/assignment_loss‚1.5997506345784853 1loss/FBt2/assignment_loss‚0.20792915370998344 /loss/FRt2/detection_loss‚2.0734455577292286 /loss/FBt2/detection_loss‚1.7789649302986534 /loss/FBt4/detection_loss‚2.3138491908709207 1loss/SRqqt4/assignment_loss‚1.716006955815644 0loss/SRqqt4/detection_loss‚2.102233627928963 _step‚268 1loss/FBt1/assignment_loss‚0.12889641968228552 trainer/global_step‚3299 /loss/FRt2/assignment_loss‚2.004931031347631 0loss/FRt3/assignment_loss‚3.0932543616870354 2loss/SRqqt1/assignment_loss‚1.0221869994630488 .loss/FRt3/detection_loss‚2.902406252663711 /loss/FBt3/detection_loss‚3.0428036955686717 /loss/FRt1/assignment_loss‚1.576403420418501 0loss/FBt3/assignment_loss‚0.2866193692899077 /loss/FRt4/detection_loss‚2.0530401740655884 0loss/SRqqt1/detection_loss‚1.102589085392776 1loss/SRqqt3/detection_loss‚2.3551784063142445 /loss/FBt1/detection_loss‚0.6429287661373818 _runtime‚3695.250639309 % _timestamp‚1.7884820431404414e+09 0loss/FRt4/assignment_loss‚3.1381356277555787 1loss/SRqqt2/detection_loss‚1.2646958579619725 0loss/FBt4/assignment_loss‚0.3682707399646385 .loss/FRt1/detection_loss‚1.788134778684859 %loss/total_loss‚39.85383027889939 epoch‚5Œ°ïu꟒‚(:” „¤èÔƪ”ª gpu.0.gpu‚83.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚209.108' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚52.276999999999994 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÂÔ¡e“‚(:Ú „¤èÔ±ìͪ cpu‚25.728849607687014 network.recv‚ 1.225932e+06$ disk./.usageGB‚2976.183250427246 disk.sdb1.out‚0 disk.sda1.in‚0! disk.sda2.out‚430.09619140625 disk.md0p1.out‚ 414.36328125* proc.memory.percent‚18.842744827270508) disk./.usagePercent‚83.21532931140642 disk.rbd2.out‚1.0625 disk.sdb1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚430.09619140625 disk.dm-0.out‚47338.81640625 disk.sda.in‚ 57.765625! disk.nvme1n1.out‚ 19842.453125 disk.sdb.in‚9.4375 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0 disk.rbd0.out‚ 0.900390625 proc.cpu.threads‚17 disk.sda.out‚430.09619140625 disk.sdb2.in‚9.4375 disk.md0.in‚ 67.203125 disk.md0.out‚ 414.36328125 disk.md0p1.in‚ 67.203125$ memory_percent‚89.19892311096191 disk.rbd2.in‚0# disk.nvme0n1.out‚27496.36328125( proc.memory.availableMB‚ 1769.6484375" proc.memory.rssMB‚ 3087.1953125 disk.nvme0n1.in‚ 220.8671875! disk.sdb2.out‚430.09619140625 network.sent‚ 7.030804e+06 disk.dm-0.in‚ 253.32421875 disk.sda1.out‚0D îÏ•”‚(:Š “¤èÔ†õß« gpu.0.gpu‚64.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚152.567' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚38.14175 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0wIY•‚(:Î “¤èÔÈŠ€¬" proc.memory.rssMB‚ 3087.1953125 disk.rbd2.in‚0) disk./.usagePercent‚83.22233242862448 disk.nvme0n1.in‚ 220.8671875 disk.sdb2.in‚9.4375 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 415.78515625# memory_percent‚89.2003059387207* proc.memory.percent‚18.842744827270508 disk.sdb2.out‚ 431.57421875 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0 disk.rbd2.out‚1.0625 disk.md0p1.in‚ 67.203125 disk.sda1.in‚0% disk./.usageGB‚2976.4337158203125 disk.sda2.out‚ 431.57421875 disk.rbd0.out‚ 0.900390625 disk.sda.out‚ 431.57421875 disk.sda1.out‚0' proc.memory.availableMB‚ 1769.421875 disk.sdb1.in‚0 disk.sda.in‚ 57.765625 network.sent‚ 7.124722e+06 disk.sdb.in‚9.4375 disk.md0.out‚ 415.78515625# disk.nvme0n1.out‚27574.78515625" disk.nvme1n1.out‚ 19842.5390625 disk.sdb1.out‚0 proc.cpu.threads‚17 network.recv‚ 1.244749e+06 disk.sdb.out‚ 431.57421875 disk.dm-0.in‚ 253.32421875 cpu‚25.728049039925864 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.out‚47417.32421875.•"Ÿ–‚(:” ¢¤èÔ–’»« gpu.0.gpu‚85.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚228.878' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚57.219500000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Jº^—‚(:Ó ¢¤èÔͯƫ disk.sda1.out‚0 disk.sdb2.out‚432.9287109375 network.recv‚ 1.248365e+06 disk.sda.in‚ 57.765625 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 cpu‚25.726949448861593) disk./.usagePercent‚83.22581148186123 disk.sdb1.out‚0 disk.sda.out‚432.9287109375 disk.md0.out‚ 417.0703125 disk.rbd2.in‚0" disk.nvme0n1.out‚ 27631.0546875 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375 disk.rbd2.out‚1.0625 disk.sdb1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125 network.sent‚ 7.129852e+06! disk.nvme1n1.out‚ 19914.671875 disk.sdb.out‚432.9287109375$ memory_percent‚89.19825553894043* proc.memory.percent‚18.842744827270508 disk.sda1.in‚0 disk.md0p1.out‚ 417.0703125 disk.rbd0.out‚ 0.900390625( proc.memory.availableMB‚ 1769.7578125" proc.memory.rssMB‚ 3087.1953125% disk./.usageGB‚2976.5581436157227 disk.sda2.out‚432.9287109375 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚ 47545.7265625 proc.cpu.threads‚17äšõV2˜- _wandbruntime‚3744  _runtime‚3744˨“Æ™À _runtime‚3744.348859385 _step‚269 & lr-AdamW/pg1‚0.0005887813201238711 & lr-AdamW/pg2‚0.0005887813201238711 trainer/global_step‚3349 $ _timestamp‚1.788482092238558e+09iïêý˚Š& lr-AdamW/pg2‚0.0005887813201238711 trainer/global_step‚3349 $ _timestamp‚1.788482092238558e+09 _runtime‚3744.348859385 _step‚269 & lr-AdamW/pg1‚0.0005887813201238711íl2›- _wandbruntime‚3744  _runtime‚3744gü‘$ò'œìO ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚458843775607808 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 _runtime‚3744.352727344 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚37656725 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚74180783 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3979701519872 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3660427963052 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚454708413335616 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚74204055 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚451048783893808 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚462516530944512 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚458843758568448 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚37656722 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚60537988 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚74204055 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3672755336704 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚462516530944512 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚517 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚451048766854448 _step‚270 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚462515730428416 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚74180783 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚458843758568448 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 134742045 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚55074895 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚394195758916608 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚60537990 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚520 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3979855470080 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 134718771 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3671971859968 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚55074375 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 trainer/global_step‚3349 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚60537990 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚462515730428416 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚60537988 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚398175435532800 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 % _timestamp‚1.7884820922423022e+09 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚458843775607808 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚517 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚451048766854448 _step‚270 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚462515730428416 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚74180783 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚458843758568448 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 134742045 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚55074895 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚394195758916608 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚60537990 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚520 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 3979855470080 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 134718771 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3671971859968 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚55074375 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 trainer/global_step‚3349 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚60537990 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚462515730428416 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚60537988 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚398175435532800 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 % _timestamp‚1.7884820922423022e+09 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚458843775607808 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 _runtime‚3744.352727344 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚37656725 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚74180783 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 3979701519872 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3660427963052 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚454708413335616 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚74204055 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚451048783893808 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚462516530944512 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680ŽÜ§Ñ2ž- _wandbruntime‚3745  _runtime‚3745ÒvŸÞŸõM D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 134757911 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚74202471 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3673821688832 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚451179417055488 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚37667482 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3673821688832 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 trainer/global_step‚3349 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3673038198784 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚60555440 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚454840924803434 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peÄ'Ž9 ak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3980855632896 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚74202471 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚55090093 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17423099 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚458976526919680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3660709226494 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 $ _timestamp‚1.788482093344587e+09 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚60555440 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚74225769 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚458976509880320 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _runtime‚3745.455295247 _step‚271 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 134781211 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚55090584 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 134781211 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚394309902719488 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 134757911 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚394309877815808 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚454840126281982 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚74225769 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚491 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3661490708586 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚60555442 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚462650348608512 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚17422611 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚462650348608512 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚398290733448704 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚462649548079104 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3673038198784 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚488 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚451179434094848 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚37667485 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3981011666944 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _runtime‚3745.455295247 _step‚271 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 134781211 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚55090584 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 134781211 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚394309902719488 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 134757911 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚394309877815808 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚454840126281982 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚74225769 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚491 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3661490708586 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚60555442 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚462650348608512 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚17422611 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚462650348608512 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚398290733448704 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚462649548079104 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3673038198784 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚488 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚451179434094848 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚37667485 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 3981011666944 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 134757911 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚74202471 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3673821688832 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚451179417055488 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚37667482 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3673821688832 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 trainer/global_step‚3349 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3673038198784 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚60555440 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚454840924803434 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 3980855632896 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚74202471 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚55090093 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17423099 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚458976526919680 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3660709226494 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 $ _timestamp‚1.788482093344587e+09 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚60555440 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360ÿ±›2¡- _wandbruntime‚3745  _runtime‚3745z©â…U¢Ï 2loss/SRqqt3/assignment_loss‚1.6757095346876762 /loss/FBt2/detection_loss‚2.4750874757766725 .loss/FBt4/detection_loss‚2.058387698496089 2loss/SRqqt4/assignment_loss‚1.2716801422057857 0loss/FBt3/assignment_loss‚0.1876533021022624 0loss/SRqqt4/detection_loss‚2.262541543430006 trainer/global_step‚3349 0loss/FBt2/assignment_loss‚0.2682584160162757 .loss/FRt1/detection_loss‚1.760790364916927 2loss/SRqqt2/assignment_loss‚1.3166385621734662 1loss/FBt1/assignment_loss‚0.13601080340966903 .loss/FRt3/detection_loss‚2.889134327896306 /loss/FBt3/detection_loss‚2.9137162193655968 %loss/total_loss‚39.66508966014601 epoch‚5 _runtime‚3745.456882524 2loss/SRqqt1/assignment_loss‚0.8768977174740137 .loss/FRt4/detection_loss‚2.207875024783954 /loss/FBt1/detection_loss‚0.6596165534726085 /loss/FRt3/assignment_loss‚2.752535212235373 $ _timestamp‚1.788482093346804e+09 0loss/FRt1/assignment_loss‚1.2087587374512867 /loss/FRt2/assignment_loss‚2.479339395250593 0loss/FRt4/assignment_loss‚2.8461675305258143 0loss/SRqqt2/detection_loss‚1.503632986539742 1loss/SRqqt3/detection_loss‚2.2115402460882536 0loss/FBt4/assignment_loss‚0.3681136964874253 -loss/FRt2/detection_loss‚2.33672551349515 1loss/SRqqt1/detection_loss‚0.9982786558650654 _step‚272‡[h\Z£Ô 1loss/FBt1/assignment_loss‚0.13601080340966903 .loss/FRt3/detection_loss‚2.889134327896306 /loss/FBt3/detection_loss‚2.9137162193655968 %loss/total_loss‚39.66508966014601 epoch‚5 _runtime‚3745.456882524 2loss/SRqqt1/assignment_loss‚0.8768977174740137 .loss/FRt4/detection_loss‚2.207875024783954 /loss/FBt1/detection_loss‚0.6596165534726085 /loss/FRt3/assignment_loss‚2.752535212235373 $ _timestamp‚1.788482093346804e+09 0loss/FRt1/assignment_loss‚1.2087587374512867 /loss/FRt2/assignment_loss‚2.479339395250593 0loss/FRt4/assignment_loss‚2.8461675305258143 0loss/SRqqt2/detection_loss‚1.503632986539742 1loss/SRqqt3/detection_loss‚2.2115402460882536 0loss/FBt4/assignment_loss‚0.3681136964874253 -loss/FRt2/detection_loss‚2.33672551349515 1loss/SRqqt1/detection_loss‚0.9982786558650654 _step‚272 2loss/SRqqt3/assignment_loss‚1.6757095346876762 /loss/FBt2/detection_loss‚2.4750874757766725 .loss/FBt4/detection_loss‚2.058387698496089 2loss/SRqqt4/assignment_loss‚1.2716801422057857 0loss/FBt3/assignment_loss‚0.1876533021022624 0loss/SRqqt4/detection_loss‚2.262541543430006 trainer/global_step‚3349 0loss/FBt2/assignment_loss‚0.2682584160162757 .loss/FRt1/detection_loss‚1.760790364916927 2loss/SRqqt2/assignment_loss‚1.3166385621734662䃩瓤‚(:ˆ ±¤èÔЖÀ« gpu.0.gpu‚3.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0íÂä`¥‚(:Õ ±¤èÔëÓ˜¬) disk./.usagePercent‚83.23280158649436 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.rbd2.out‚1.0625# disk.nvme0n1.out‚27753.07421875 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.nvme0n1.in‚ 220.8671875 proc.cpu.threads‚17 disk.sdb2.out‚435.2529296875 disk.rbd0.out‚ 0.900390625 disk.sdb.out‚435.2529296875 disk.sdb2.in‚9.4375 disk.md0p1.out‚ 419.3203125 disk.sdb1.out‚0" proc.memory.rssMB‚ 3087.1953125 cpu‚25.725975244970915 disk.sdb1.in‚0 disk.sda.out‚435.2529296875 network.sent‚ 7.155735e+06 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.in‚ 67.203125 disk.dm-0.out‚ 47811.9140625$ memory_percent‚89.20011520385742* proc.memory.percent‚18.842744827270508 network.recv‚ 1.266408e+06% disk./.usageGB‚2976.8081436157227 disk.sda1.in‚0' proc.memory.availableMB‚ 1769.453125# disk.nvme1n1.out‚20058.83984375 disk.sda2.in‚ 57.765625 disk.sda2.out‚435.2529296875 disk.md0.out‚ 419.3203125 disk.sda.in‚ 57.765625 disk.sda1.out‚0ÑhÖ¦‚(:’ À¤èÔÝル gpu.0.gpu‚23.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚222.134' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚55.53349999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0÷»a§‚(:Ö À¤èÔ…èë«) disk./.usagePercent‚83.23280158649436 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875$ memory_percent‚89.20013904571533 network.sent‚ 7.22861e+06 disk.sdb.in‚9.4375 disk.rbd0.out‚ 0.900390625 disk.sda1.in‚0) proc.memory.availableMB‚ 1769.44921875# disk.nvme0n1.out‚27809.36328125 disk.sda2.out‚436.8056640625 disk.md0p1.in‚ 67.203125 disk.sda.in‚ 57.765625 disk.sda2.in‚ 57.765625 disk.rbd2.out‚1.0625 disk.sda1.out‚0 proc.cpu.threads‚17 network.recv‚ 1.271067e+06 disk.nvme0n1.in‚ 220.8671875 disk.md0p1.out‚ 420.80859375" proc.memory.rssMB‚ 3087.1953125 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚436.8056640625 disk.md0.out‚ 420.80859375* proc.memory.percent‚18.842744827270508 cpu‚25.7252861163365% disk./.usageGB‚2976.8081436157227 disk.sdb2.in‚9.4375 disk.dm-0.out‚48012.35546875 disk.sdb1.out‚0 disk.sda.out‚436.8056640625" disk.nvme1n1.out‚ 20202.9921875 disk.sdb2.out‚436.8056640625 disk.rbd2.in‚0 disk.sdb1.in‚0ÊKï¸^¨‚(:Ó ϤèÔåÚÖª network.recv‚ 1.282091e+06 disk.sda2.out‚ 438.318359375 disk.dm-0.out‚ 48202.1328125 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚20347.06640625 disk.sdb2.in‚9.4375) proc.memory.availableMB‚ 1768.92578125% disk./.usageGB‚2977.3078231811523 disk.md0p1.in‚ 67.203125 disk.sda1.out‚0 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda.in‚ 57.765625# memory_percent‚89.2033338546753 cpu‚25.72467872441042) disk./.usagePercent‚83.24677283627592 disk.rbd0.in‚0 disk.rbd0.out‚ 0.900390625 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.4375 disk.sdb2.out‚ 438.318359375* proc.memory.percent‚18.842744827270508 network.sent‚ 7.240621e+06 disk.md0.out‚ 422.26953125 disk.rbd2.in‚0 disk.rbd2.out‚1.0625# disk.nvme0n1.out‚27855.06640625 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 422.26953125 disk.sdb.out‚ 438.318359375 proc.cpu.threads‚17 disk.dm-0.in‚ 253.32421875 disk.sda.out‚ 438.318359375 disk.sda2.in‚ 57.765625" proc.memory.rssMB‚ 3087.1953125£¼_•©‚(:Š ϤèÔàÜÆ« gpu.0.gpu‚65.0 gpu.0.memory‚15, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚207.761' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.94025 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0|‘P*“ª‚(:ˆ Þ¤èÔ¨‰¡« gpu.0.gpu‚3.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‚kÌ-S«‚(:È Þ¤èÔÕø÷«% proc.memory.availableMB‚ 1769.6875" proc.memory.rssMB‚ 3087.1953125* proc.memory.percent‚18.842744827270508 disk.sda.in‚ 57.765625 disk.nvme1n1.in‚ 32.45703125 disk.md0.out‚ 423.65625 disk.rbd0.out‚ 0.900390625 proc.cpu.threads‚17 disk.sdb1.in‚0 disk.sda1.out‚0 disk.md0.in‚ 67.203125 disk.rbd2.out‚1.0625 cpu‚25.72410762734568 disk.sdb1.out‚0# disk.nvme1n1.out‚20491.27734375 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875$ memory_percent‚89.19868469238281 disk.nvme0n1.in‚ 220.8671875 disk.sda2.out‚ 439.763671875) disk./.usagePercent‚83.23908986482613 disk.sdb.in‚9.4375 disk.sdb2.out‚ 439.763671875 disk.sda2.in‚ 57.765625 disk.sda1.in‚0 disk.rbd0.in‚0 network.sent‚ 7.24492e+06$ disk./.usageGB‚2977.033042907715 disk.sda.out‚ 439.763671875 disk.dm-0.out‚ 48473.6171875 disk.rbd2.in‚0 network.recv‚ 1.285204e+06# disk.nvme0n1.out‚27982.33984375 disk.sdb.out‚ 439.763671875 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 423.65625©M2¬- _wandbruntime‚3796  _runtime‚3796wE;ìÅ­¿ % lr-AdamW/pg2‚0.000571506519079449 trainer/global_step‚3399 % _timestamp‚1.7884821439265916e+09 _runtime‚3796.041857546 _step‚273 % lr-AdamW/pg1‚0.000571506519079449dù+樀 % lr-AdamW/pg1‚0.000571506519079449 % lr-AdamW/pg2‚0.000571506519079449 trainer/global_step‚3399 % _timestamp‚1.7884821439265916e+09 _runtime‚3796.041857546 _step‚273‘gÞ‘2¯- _wandbruntime‚3796  _runtime‚3796Ѥmé«°ìO OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚461294886347168 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3725316628992 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚61410590 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚469206640791040 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚61410588 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚469207441307136 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚469206640791040 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚461294087825924 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 trainer/global_step‚3399 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚457581293945808 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚399902924156928 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚38194722 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚38194725 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚457581276906448 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 136679123 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚17669333 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚465481341201408 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚399902949060608 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 136702397 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚403940749884416 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚61410588 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚75268535 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚55864058 QIDeviceStatsMonitor.on_train_batch_start/inactivm–â£Ge_split.small_pool.current‚534 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3713592401360 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚465481324162048 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚403940922446848 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4037825727488 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3712810919476 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚61410590 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚274 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚17668799 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚465481324162048 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚465481341201408 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3726100105728 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚75291807 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4037973386240 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147658752 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚469207441307136 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3726100105728 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 % _timestamp‚1.7884821439273562e+09 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚537 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3725316628992 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚469206640791040 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚61410588 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚469207441307136 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚469206640791040 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚461294087825924 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 trainer/global_step‚3399 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚457581293945808 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚399902924156928 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚38194722 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚38194725 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚457581276906448 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 136679123 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚17669333 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚465481341201408 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚399902949060608 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 136702397 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚403940749884416 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚61410588 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚75268535 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚55864058 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚534 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3713592401360 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚465481324162048 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚403940922446848 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4037825727488 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3712810919476 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚61410590 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚274 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚17668799 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476’˜öbá2²- _wandbruntime‚3796  _runtime‚3796˜´¹°ü&³öM F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚465614075473920 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚55879221 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4039143147520 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 136718263 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚469341258971136 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 trainer/global_step‚3399 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3727166457856 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚465614092513280 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17674255 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 136718263 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚400017092863488 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚457711944146848 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 136741563 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚38205485 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚465614092513280 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚61428042 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚404056236011008 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚465614075473920 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚75290223 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚61428040 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚400017067959808 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚461425800772290 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚461426599293742 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0ê¡;«q´ûM I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚38205482 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 136741563 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚17673739 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 149742592 _runtime‚3796.916890098 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚61428042 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚75313521 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 136741563 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚38205485 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚465614092513280 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚61428042 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚404056236011008 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚465614075473920 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚75290223 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚61428040 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚400017067959808 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚461425800772290 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚461426599293742 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_>Ãk batch_end/reserved_bytes.small_pool.current‚ 998244352 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚465614075473920 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚519 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚55879221 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4039143147520 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 136718263 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚469341258971136 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 trainer/global_step‚3399 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3727166457856 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚465614092513280 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17674255 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 136718263 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚400017092863488 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚457711944146848 EDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚475897551153664 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚467880560837476 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚516 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚464113803997808 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚3849.678803217 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚76356287 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚475898351669760 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3779444874752 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚405610139204608 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4095845919744 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚475898351669760 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚409706132783104 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚56652887 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3765975357784 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4095993578496 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚472118889755648 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884821975654814e+09 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3766756839668 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚405610114300928 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 138639475 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚38732725 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚76356287 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚475898351669760 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3779444874752 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚405610139204608 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4095845919744 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚475898351669760 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚409706132783104 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚56652887 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3765975357784 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4095993578496 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚472118889755648 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884821975654814e+09 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3766756839668 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚405610114300928 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 138639475 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚38732725 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚475897551153664 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚467880560837476 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚516 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚464113803997808 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚3849.678803217 JDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 138701915 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 trainer/global_step‚3449 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚76401273 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚56668168 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚62300642 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚62300640 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_poo C¬ä l.allocated‚405724283007488 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚76401273 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚409821253426176 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚62300640 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚17924686 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 138678615 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚409821438558208 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3780511226880 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚476031368804352 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚472251658106880 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 138701915 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚38743482 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚62300642 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17925195 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚76377975 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 _runtime‚3850.753734981 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚472251641067520 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚472251641067520 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3779727736832 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚468011475262598 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚464244437159488 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3767038103110 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4096995322368 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 138678615 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚464244454198848 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 % _timestamp‚1.7884821986427555e+09 _step‚279 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚472251641067520 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3779727736832 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚468011475262598 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚464244437159488 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3767038103110 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4096995322368 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 138678615 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚464244454198848 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 % _timestamp‚1.7884821986427555e+09 _step‚279 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 138701915 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 trainer/global_step‚3449 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚76401273 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚56668168 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚62300642 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚62300640 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚405724283007488 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚76401273 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚409821253426176 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚62300640 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚17924686 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 138678615 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚409821438558208 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3780511226880 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚476031368804352 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚472251658106880 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 138701915 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚38743482 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚62300642 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚17925195 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚76377975 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 _runtime‚3850.753734981 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚472251641067520 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0—©S,b2Ç- _wandbruntime‚3850  _runtime‚3850JX oWÈÑ 2loss/SRqqt1/assignment_loss‚1.0091648112274707 2loss/SRqqt2/assignment_loss‚1.2002791537662278 .loss/FBt2/detection_loss‚1.424961760174483 %loss/total_loss‚39.76085579098556 epoch‚5 1loss/SRqqt3/assignment_loss‚1.790246582937007 1loss/FBt4/assignment_loss‚0.21543843870049842 /loss/FBt3/detection_loss‚2.5772372744977474 % _timestamp‚1.7884821986452498e+09 _runtime‚3850.755288308 0loss/FRt2/assignment_loss‚2.0445092609054165 1loss/SRqqt2/detection_loss‚1.3318832590655014 0loss/FRt3/assignment_loss‚3.3784268452570987 -loss/FRt2/detection_loss‚2.08699176060526 /loss/FRt4/detection_loss‚2.0720209988349487 /loss/FBt1/detection_loss‚0.7293951764533465 _step‚280 2loss/SRqqt4/assignment_loss‚1.7728394029269878 0loss/FBt3/assignment_loss‚0.1529745324708358 0loss/SRqqt4/detection_loss‚2.001015415317134 .loss/FBt4/detection_loss‚2.642878007888794 /loss/FRt1/detection_loss‚1.7665848792064935 .loss/FRt3/detection_loss‚3.095052855519148 0loss/SRqqt3/detection_loss‚2.669760817406224 trainer/global_step‚3449 /loss/FBt1/assignment_loss‚0.112229412497272 1loss/FBt2/assignment_loss‚0.19707918247797807 0loss/SRqqt1/detection_loss‚1.103199020266533 0loss/FRt1/assignment_loss‚1.3660379070043565 0loss/FRt4/assignment_loss‚3.0206490355787925òLð×\ÉÖ 0loss/SRqqt4/detection_loss‚2.001015415317134 .loss/FBt4/detection_loss‚2.642878007888794 /loss/FRt1/detection_loss‚1.7665848792064935 .loss/FRt3/detection_loss‚3.095052855519148 0loss/SRqqt3/detection_loss‚2.669760817406224 trainer/global_step‚3449 /loss/FBt1/assignment_loss‚0.112229412497272 1loss/FBt2/assignment_loss‚0.19707918247797807 0loss/SRqqt1/detection_loss‚1.103199020266533 0loss/FRt1/assignment_loss‚1.3660379070043565 0loss/FRt4/assignment_loss‚3.0206490355787925 2loss/SRqqt1/assignment_loss‚1.0091648112274707 2loss/SRqqt2/assignment_loss‚1.2002791537662278 .loss/FBt2/detection_loss‚1.424961760174483 %loss/total_loss‚39.76085579098556 epoch‚5 1loss/SRqqt3/assignment_loss‚1.790246582937007 1loss/FBt4/assignment_loss‚0.21543843870049842 /loss/FBt3/detection_loss‚2.5772372744977474 % _timestamp‚1.7884821986452498e+09 _runtime‚3850.755288308 0loss/FRt2/assignment_loss‚2.0445092609054165 1loss/SRqqt2/detection_loss‚1.3318832590655014 0loss/FRt3/assignment_loss‚3.3784268452570987 -loss/FRt2/detection_loss‚2.08699176060526 /loss/FRt4/detection_loss‚2.0720209988349487 /loss/FBt1/detection_loss‚0.7293951764533465 _step‚280 2loss/SRqqt4/assignment_loss‚1.7728394029269878 0loss/FBt3/assignment_loss‚0.1529745324708358˜q;9k”Ê‚(:‰ š¥èÔÇ燭 gpu.0.gpu‚12.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0?Þ£š_Ë‚(:Ô š¥èÔÐàš® disk.sdb.in‚9.4375 disk.sda2.in‚ 57.765625 disk.md0.out‚ 430.703125 disk.dm-0.out‚ 49213.1171875 disk.rbd2.in‚0 disk.rbd2.out‚1.0625 disk.nvme0n1.in‚ 220.8671875 disk.md0p1.in‚ 67.203125! proc.memory.rssMB‚ 3011.484375 proc.cpu.threads‚17 disk.rbd0.out‚ 0.900390625 network.sent‚ 7.359438e+06 disk.sda.in‚ 57.765625! disk.sdb2.out‚447.04931640625 network.recv‚ 1.3032e+06( disk./.usagePercent‚83.2432959162498# disk.nvme0n1.out‚28026.19140625 disk.sdb.out‚447.04931640625 disk.md0p1.out‚ 430.703125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875$ memory_percent‚88.73922824859619% disk./.usageGB‚2977.1834716796875 cpu‚25.721648820945546 disk.sda1.out‚0 disk.sdb1.in‚0 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚21186.92578125 disk.sdb2.in‚9.4375) proc.memory.availableMB‚ 1844.96484375) proc.memory.percent‚18.38064193725586 disk.sdb1.out‚0 disk.sda.out‚447.04931640625! disk.sda2.out‚447.04931640625 disk.md0.in‚ 67.203125xÐxÝ•Ì‚(:Š ©¥èÔçíº« gpu.0.gpu‚85.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚229.155' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.28875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ĤaÍ‚(:Ö ©¥èÔ®¬î¬ disk.sda.in‚ 57.765625 disk.sdb2.in‚9.4375! disk.sdb2.out‚448.74658203125 disk.rbd0.in‚0 disk.dm-0.out‚49437.30078125 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚448.74658203125 disk.sda2.in‚ 57.765625) disk./.usagePercent‚83.24679043526372 disk.sdb1.out‚0 disk.md0.out‚ 432.328125 disk.md0p1.out‚ 432.328125$ memory_percent‚88.74866962432861) proc.memory.availableMB‚ 1843.41796875 proc.cpu.threads‚17$ disk./.usageGB‚2977.308452606201 disk.md0p1.in‚ 67.203125# proc.memory.rssMB‚ 3012.73046875( proc.memory.percent‚18.3882474899292 cpu‚25.721136254200083 network.sent‚ 7.433868e+06 disk.nvme0n1.in‚ 220.8671875 disk.rbd0.out‚ 0.900390625 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125 network.recv‚ 1.30889e+06 disk.sda.out‚448.74658203125# disk.nvme0n1.out‚28026.23046875" disk.nvme1n1.out‚ 21411.0703125 disk.rbd2.out‚1.0625 disk.sda1.out‚0! disk.sda2.out‚448.74658203125 disk.dm-0.in‚ 253.32421875¨•Î‚(:Š ¸¥èÔµó³« gpu.0.gpu‚77.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚123.095' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.77375 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚00í³=NÏ‚(:à ¸¥èÔžÎü¬ disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚21681.05859375 disk.sdb2.in‚9.4375 network.sent‚ 7.441174e+06 disk.md0p1.in‚ 67.203125 disk.rbd2.out‚1.0625 disk.rbd0.out‚ 0.900390625 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0 disk.sda.in‚ 57.765625# proc.memory.rssMB‚ 3012.73046875( proc.memory.percent‚18.3882474899292) disk./.usagePercent‚83.24679043526372 disk.sdb1.in‚0 disk.sdb.out‚ 450.40625) proc.memory.availableMB‚ 1843.55078125 disk.rbd2.in‚0$ memory_percent‚88.74785900115967 proc.cpu.threads‚17# disk.nvme0n1.out‚28026.32421875 disk.sda2.in‚ 57.765625 disk.sda2.out‚ 450.40625 network.recv‚ 1.312501e+06$ disk./.usageGB‚2977.308452606201 disk.dm-0.out‚ 49707.3828125 disk.sda.out‚ 450.40625 disk.sda1.out‚0 disk.md0p1.out‚ 433.92578125 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125 disk.md0.out‚ 433.92578125 disk.sda1.in‚0 disk.sdb2.out‚ 450.40625 disk.rbd0.in‚0 disk.sdb.in‚9.4375 cpu‚25.720735297511848Jl&lЂ(:’ Ç¥èÔ¶™þ« gpu.0.gpu‚6.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0—úbaÑ‚(:Ö Ç¥èÔÄá…­# proc.memory.rssMB‚ 3012.73046875 disk.sda.in‚ 57.765625 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375) proc.memory.availableMB‚ 1843.69921875( disk./.usagePercent‚83.2467920351717 disk.md0p1.out‚ 435.66796875 network.recv‚ 1.31728e+06 disk.md0.out‚ 435.66796875 disk.rbd0.out‚ 0.900390625 disk.rbd2.in‚0 disk.sda.out‚452.22607421875# disk.nvme0n1.out‚28026.38671875 proc.cpu.threads‚17 disk.rbd0.in‚0 disk.sda1.in‚0 disk.sdb.out‚452.22607421875 disk.sda2.in‚ 57.765625 cpu‚25.720464622053814 disk.sdb1.in‚0# disk./.usageGB‚2977.30850982666 disk.md0p1.in‚ 67.203125 disk.dm-0.out‚49856.19140625 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 network.sent‚ 7.4476e+06 disk.rbd2.out‚1.0625 disk.sda1.out‚0" disk.nvme1n1.out‚ 21833.3046875! disk.sdb2.out‚452.22607421875 disk.md0.in‚ 67.203125( proc.memory.percent‚18.3882474899292 disk.sdb1.out‚0 disk.dm-0.in‚ 253.32421875! disk.sda2.out‚452.22607421875$ memory_percent‚88.74695301055908¯w&õ2Ò- _wandbruntime‚3903  _runtime‚3903Ž-‰<ÆÓÀ _runtime‚3903.449029286 _step‚281 & lr-AdamW/pg1‚0.0005370379676318511 & lr-AdamW/pg2‚0.0005370379676318511 trainer/global_step‚3499 $ _timestamp‚1.788482251338365e+09Y¸­aËÔÅ trainer/global_step‚3499 $ _timestamp‚1.788482251338365e+09 _runtime‚3903.449029286 _step‚281 & lr-AdamW/pg1‚0.0005370379676318511 & lr-AdamW/pg2‚0.0005370379676318511™T¶Lï2Õ- _wandbruntime‚3903  _runtime‚3903$jÁùÖìO [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚77467311 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚77467311 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚77444039 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚478756472388608 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚474465436806540 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚478756472388608 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3832789643776 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚482589262032384 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚57439608 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4153942543872 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3819139796092 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3832006167040 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 140623101 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚411317304444928 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WGDeviceStatsMonitor’Àiù.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚18168886 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 _step‚282 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3832789643776 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚482588461516288 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚411317329348608 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚63155790 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚415471246988800 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚63155788 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚478756455349248 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚478756455349248 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚482588461516288 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚411317329348608 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚63155790 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚415471246988800 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚63155788 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚478756455349248 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚478756455349248 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚77467311 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚77467311 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚77444039 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚478756472388608 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚474465436806540 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚478756472388608 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3832789643776 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚482589262032384 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚57439608 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4153942543872 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3819139796092 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3832006167040 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 140623101 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚411317304444928 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚18168886 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 _step‚282 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3832789643776 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚57455393 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚63173242 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚77489025 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚18173911 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚415586545228288 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _step‚283 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚18174423 _runtime‚3904.375104718 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4155253014528 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚63173242 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚415586726166016 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚482722279166976 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚57455908 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚515 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3820984023510 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 140638967 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4155096980480 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚77465727 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚39281482 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚470776964250848 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3833855995904 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚474597149752906 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3833072505856 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚482723079696384 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚478889223700480 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚474597948274358 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚77465727 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚39281485 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚77489025 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 140662267 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚411431448247808 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 140662267 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚411431448247808 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚57455393 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚63173242 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚77489025 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚18173911 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚415586545228288 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _step‚283 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚18174423 _runtime‚3904.375104718 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4155253014528 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚63173242 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚415586726166016 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚482722279166976 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚57455908 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚515 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3820984023510 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 140638967 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4155096980480 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚77465727 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚39281482 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚470776964250848›’¹¤2Û- _wandbruntime‚3904  _runtime‚3904FËXž^ÜØ 1loss/FBt3/assignment_loss‚0.21374673382743223 .loss/FRt2/detection_loss‚2.054323878683401 1loss/SRqqt1/detection_loss‚0.8722181347306488 _runtime‚3904.376202023 0loss/FBt4/assignment_loss‚0.1870619113259588 2loss/SRqqt3/assignment_loss‚1.7117846478978473 /loss/FRt4/detection_loss‚2.1455921065926398 1loss/FBt1/assignment_loss‚0.11154976199772017 0loss/SRqqt3/detection_loss‚2.460804172581242 0loss/SRqqt4/detection_loss‚2.346182510012486 /loss/FBt4/detection_loss‚2.0616927774328935 trainer/global_step‚3499 $ _timestamp‚1.788482252266139e+09 _step‚284 0loss/FRt2/assignment_loss‚2.1340309488639404 0loss/FRt3/assignment_loss‚3.0509206343580177 2loss/FBt2/assignment_loss‚0.010949756649257751 /loss/FBt3/detection_loss‚2.2617093365300787 .loss/FRt1/detection_loss‚1.688973491181704 0loss/FBt1/detection_loss‚0.48022557102642904 %loss/total_loss‚38.38772734098661 epoch‚5 /loss/FRt4/assignment_loss‚3.113365197919079 2loss/SRqqt1/assignment_loss‚1.0519402975020107 2loss/SRqqt2/assignment_loss‚1.3199784889285053 2loss/SRqqt4/assignment_loss‚1.6266970068338464 0loss/FRt1/assignment_loss‚1.4056895678693597 /loss/FRt3/detection_loss‚2.9043083179880074 1loss/SRqqt2/detection_loss‚1.2582953025453858 /loss/FBt2/detection_loss‚1.9156867877087171o&œÏcÝÝ 2loss/SRqqt3/assignment_loss‚1.7117846478978473 /loss/FRt4/detection_loss‚2.1455921065926398 1loss/FBt1/assignment_loss‚0.11154976199772017 0loss/SRqqt3/detection_loss‚2.460804172581242 0loss/SRqqt4/detection_loss‚2.346182510012486 /loss/FBt4/detection_loss‚2.0616927774328935 trainer/global_step‚3499 $ _timestamp‚1.788482252266139e+09 _step‚284 0loss/FRt2/assignment_loss‚2.1340309488639404 0loss/FRt3/assignment_loss‚3.0509206343580177 2loss/FBt2/assignment_loss‚0.010949756649257751 /loss/FBt3/detection_loss‚2.2617093365300787 .loss/FRt1/detection_loss‚1.688973491181704 0loss/FBt1/detection_loss‚0.48022557102642904 %loss/total_loss‚38.38772734098661 epoch‚5 /loss/FRt4/assignment_loss‚3.113365197919079 2loss/SRqqt1/assignment_loss‚1.0519402975020107 2loss/SRqqt2/assignment_loss‚1.3199784889285053 2loss/SRqqt4/assignment_loss‚1.6266970068338464 0loss/FRt1/assignment_loss‚1.4056895678693597 /loss/FRt3/detection_loss‚2.9043083179880074 1loss/SRqqt2/detection_loss‚1.2582953025453858 /loss/FBt2/detection_loss‚1.9156867877087171 1loss/FBt3/assignment_loss‚0.21374673382743223 .loss/FRt2/detection_loss‚2.054323878683401 1loss/SRqqt1/detection_loss‚0.8722181347306488 _runtime‚3904.376202023 0loss/FBt4/assignment_loss‚0.1870619113259588œ¯öãwÞ‚(:… Ö¥èÔ“䛫 gpu.0.gpu‚48.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚195.68' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚48.92 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¦ÛÛ_fß‚(:Û Ö¥èÔÌ‹·¬ disk.sda.out‚453.81591796875# disk.nvme0n1.out‚28026.48046875 disk.sda2.in‚ 57.765625! disk.sda2.out‚453.81591796875 disk.rbd0.in‚0( proc.memory.percent‚18.3882474899292 disk.sda1.in‚0" disk.nvme1n1.out‚ 22028.6484375 disk.md0p1.out‚ 437.19921875$ memory_percent‚88.74914646148682# proc.memory.rssMB‚ 3012.73046875) disk./.usagePercent‚83.24679043526372 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.out‚ 0.900390625 disk.rbd2.in‚0 cpu‚25.719636011862566 disk.sda.in‚ 57.765625 disk.sdb2.in‚9.4375! disk.sdb2.out‚453.81591796875 disk.md0p1.in‚ 67.203125 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚50055.12890625 disk.sdb1.in‚0 proc.cpu.threads‚17 disk.rbd2.out‚1.0625 disk.sdb.out‚453.81591796875 network.recv‚ 1.320796e+06$ disk./.usageGB‚2977.308452606201 disk.sdb.in‚9.4375 disk.md0.out‚ 437.19921875 disk.sdb1.out‚0) proc.memory.availableMB‚ 1843.33984375 disk.md0.in‚ 67.203125 network.sent‚ 7.450522e+06àÝœ1”à‚(:‰ å¥èÔ¦ÙÙ© gpu.0.gpu‚61.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚227.082' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.7705 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Øáå_á‚(:Ô å¥èÔ€Ū disk.dm-0.out‚50255.41015625 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.sda1.in‚0 network.recv‚ 1.326685e+06 disk.md0.in‚ 67.203125 disk.sdb1.in‚0# disk.nvme0n1.out‚28026.51953125$ memory_percent‚88.75093460083008 disk.sdb.out‚455.3720703125 disk.sda.in‚ 57.765625! disk.nvme1n1.out‚ 22228.890625# proc.memory.rssMB‚ 3012.73046875 disk.sdb2.in‚9.4375 disk.md0.out‚ 438.69140625 disk.md0p1.out‚ 438.69140625 cpu‚25.718704891936888$ disk./.usageGB‚2977.033805847168 disk.sdb.in‚9.4375 disk.rbd2.out‚1.0625' proc.memory.availableMB‚ 1843.046875 proc.cpu.threads‚17 disk.sdb2.out‚455.3720703125 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.sda.out‚455.3720703125( proc.memory.percent‚18.3882474899292 network.sent‚ 7.537758e+06 disk.rbd0.out‚ 0.900390625 disk.sda1.out‚0) disk./.usagePercent‚83.23911119693254 disk.sda2.out‚455.3720703125L å^â‚(:Ó ô¥èÔýíª network.sent‚ 7.54523e+06 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.out‚ 50435.5703125 disk.rbd2.in‚0 disk.sda.in‚ 57.765625% disk./.usageGB‚2975.9293632507324 disk.sda2.in‚ 57.765625 disk.md0.out‚ 440.40625 disk.md0p1.out‚ 440.40625 disk.dm-0.in‚ 253.32421875' proc.memory.availableMB‚ 1843.296875# proc.memory.rssMB‚ 3012.73046875 cpu‚25.718190634965058 disk.rbd0.out‚ 0.900390625 disk.sda1.out‚0 proc.cpu.threads‚17) disk./.usagePercent‚83.20823051969107 disk.sdb2.in‚9.4375 disk.md0.in‚ 67.203125 disk.sdb1.out‚0$ memory_percent‚88.74940872192383( proc.memory.percent‚18.3882474899292 network.recv‚ 1.330465e+06# disk.nvme1n1.out‚22408.90234375 disk.sdb.in‚9.4375 disk.md0p1.in‚ 67.203125 disk.sdb1.in‚0# disk.nvme0n1.out‚28026.66796875 disk.sdb.out‚457.14599609375! disk.sdb2.out‚457.14599609375! disk.sda2.out‚457.14599609375 disk.rbd0.in‚0 disk.rbd2.out‚1.0625 disk.sda.out‚457.14599609375 disk.nvme0n1.in‚ 220.8671875 disk.sda1.in‚0¸„qÔ“ã‚(:ˆ ô¥èÔ‰£óª gpu.0.gpu‚77.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚226.37' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.5925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ñ»Ñ2ä- _wandbruntime‚3954  _runtime‚39549êÅå¿ % lr-AdamW/pg1‚0.000519872996094268 % lr-AdamW/pg2‚0.000519872996094268 trainer/global_step‚3549 % _timestamp‚1.7884823021159353e+09 _runtime‚3954.226236645 _step‚285­EÓÑÊæÄ % _timestamp‚1.7884823021159353e+09 _runtime‚3954.226236645 _step‚285 % lr-AdamW/pg1‚0.000519872996094268 % lr-AdamW/pg2‚0.000519872996094268 trainer/global_step‚3549¥ÌH×2ç- _wandbruntime‚3954  _runtime‚3954”é×ï'èéO PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚78531791 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚489279371878912 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚481051909818092 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3873085716284 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚421236433517056 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3886134412800 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚58229073 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚78531791 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚64028390 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚64028388 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3885350936064 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4211938928128 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚485394020942848 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚78555063 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚489280172395008 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚528 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4212099169792 _step‚286 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚39808722 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚477178824101808 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚489279371878912 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 142583453 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚64028390 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _runtime‚ 3954.227461 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚39808725 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3872304234400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚78555063 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚489280172395008 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 3886134412800 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚485394037982208 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚58228542 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚477178807062448 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 142560179 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚485394037982208 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3885350936064 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚481051111296848 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884823021170988e+09 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚421236618662400 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚485394037982208 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚58228542 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚477178807062448 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 142560179 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚485394037982208 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3885350936064 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚481051111296848 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884823021170988e+09 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚421236618662400 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚489279371878912 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚481051909818092 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3873085716284 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚421236433517056 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3886134412800 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785ž÷3d»2ê- _wandbruntime‚3955  _runtime‚3955úBúÎmëöM D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 142599319 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚477309474302848 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3887200764928 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚58244751 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 142622619 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚64045840 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 T@DeviceStatsMonitor.on_train_batch_enIË¥!d/active_bytes.all.allocated‚489413990059008 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4213249410048 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚485526772254720 trainer/global_step‚3549 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚58244244 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚421351735962112 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚489413189529600 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚39819482 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3887200764928 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3886417274880 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3886417274880 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚78576777 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚78576777 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚39819485 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4213097570304 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚417138638391808 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚477309457263488 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3874148461818 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚64045842 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚18425266 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 142622619 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚485526789294080 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 % _timestamp‚1.7884823029644468e+09 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 142599319 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 _runtime‚3955.075316007 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚481182824243214 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚64045842 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744‘-’'ìûM LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚489413990059008 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚78576777 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚78576777 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚39819485 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4213097570304 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚417138638391808 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚477309457263488 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 3874148461818 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚64045842 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚18425266 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 142622619 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚485526789294080 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 % _timestamp‚1.7884823029644468e+09 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 142599319 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 _runtime‚3955.075316007 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚481182824243214 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚64045842 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 142599319 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚477309474302848 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 3887200764928 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚58244751 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 142622619 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚64045840 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚489413990059008 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4213249410048 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚485526772254720 trainer/global_step‚3549 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚58244244 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚421351735962112 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚489413189529600 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚39819482 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 3887200764928 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3886417274880 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 3886417274880 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 Fi•ò‚(:Š ’¦èÔýÊÁ« gpu.0.gpu‚83.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚202.531' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚50.63275 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0wH”`ó‚(:Õ ’¦èÔìóþ«# disk.nvme0n1.out‚28027.48828125) proc.memory.availableMB‚ 1843.26171875 network.recv‚ 1.339569e+06 disk.sdb.out‚460.7041015625 disk.sdb2.in‚9.4375 disk.rbd0.out‚ 0.900390625 disk.sdb1.in‚0# proc.memory.rssMB‚ 3012.73046875 disk.md0.out‚ 443.83203125 disk.dm-0.in‚ 253.32421875 disk.sda1.in‚0 network.sent‚ 7.637456e+06) disk./.usagePercent‚83.21189324236413 disk.md0.in‚ 67.203125 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚22626.16796875 cpu‚25.717790052659613 disk.nvme0n1.in‚ 220.8671875$ memory_percent‚88.74962329864502 disk.sda2.out‚460.7041015625 disk.dm-0.out‚ 50653.65625 disk.sdb1.out‚0 disk.sda.out‚460.7041015625 proc.cpu.threads‚17 disk.sdb.in‚9.4375 disk.sdb2.out‚460.7041015625( proc.memory.percent‚18.3882474899292 disk.md0p1.in‚ 67.203125$ disk./.usageGB‚2976.060359954834 disk.rbd2.out‚1.0625 disk.sda2.in‚ 57.765625 disk.md0p1.out‚ 443.83203125 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sda.in‚ 57.765625 disk.sda1.out‚0Ø|2,”ô‚(:‰ ¡¦èÔ¶« gpu.0.gpu‚63.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚118.142' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.5355 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¤Ø`õ‚(:Õ ¡¦èÔ²¤Ë« network.sent‚ 7.641868e+06) disk./.usagePercent‚83.21365740756542 disk.sda.in‚ 57.765625 disk.sda.out‚462.64794921875 disk.sdb.in‚9.4375 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚1.0625) proc.memory.availableMB‚ 1843.16015625! disk.sda2.out‚462.64794921875 disk.rbd0.out‚ 0.900390625$ memory_percent‚88.75024318695068# proc.memory.rssMB‚ 3012.73046875( proc.memory.percent‚18.3882474899292 cpu‚25.717480846542355 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sdb.out‚462.64794921875 disk.md0p1.in‚ 67.203125 network.recv‚ 1.344256e+06% disk./.usageGB‚2976.1234550476074 disk.sda1.out‚0 disk.sda2.in‚ 57.765625 disk.dm-0.out‚50706.09765625 disk.rbd2.in‚0 proc.cpu.threads‚17 disk.nvme0n1.in‚ 220.8671875 disk.nvme0n1.out‚ 28028.9375 disk.rbd0.in‚0 disk.sda1.in‚0 disk.sdb2.in‚9.4375 disk.md0p1.out‚ 445.703125 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚462.64794921875 disk.md0.in‚ 67.203125 disk.md0.out‚ 445.703125# disk.nvme1n1.out‚22677.16015625ó•/z2ö- _wandbruntime‚4004  _runtime‚4004 {÷Ç÷Á % _timestamp‚1.7884823521886635e+09 _runtime‚4004.301875417 _step‚289 & lr-AdamW/pg1‚0.0005027733502978031 & lr-AdamW/pg2‚0.0005027733502978031 trainer/global_step‚3599lT˜·ÌøÆ & lr-AdamW/pg1‚0.0005027733502978031 & lr-AdamW/pg2‚0.0005027733502978031 trainer/global_step‚3599 % _timestamp‚1.7884823521886635e+09 _runtime‚4004.301875417 _step‚289¡9¢Á2ù- _wandbruntime‚4004  _runtime‚4004ÍYx8úëO P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3926250154592 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 144520531 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚492031603575808 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚492031603575808 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚18671328 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚4004.302874302 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚40346725 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚495971082757632 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚64900990 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚519 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚64900990 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚64900988 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚79619543 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4269878879232 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚79642815 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚427001740368896 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚18671847 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚427001563612160 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3925468672708 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚495970282241536 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚40346722 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚79642815 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4270030732288 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚487637584308400 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 trainer/global_step‚3599 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3939479181824 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3938695705088 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚59018050 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚64900988 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚79619543 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚492031586536448 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3938695705088 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 144543805 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272¯ J¾ö'ûðO UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚495970282241536 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚59018572 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚483711334153808 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚487636785787156 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚495970282241536 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚40346722 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚79642815 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4270030732288 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚487637584308400 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 trainer/global_step‚3599 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 3939479181824 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 3938695705088 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚59018050 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚64900988 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚79619543 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚492031586536448 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 3938695705088 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 144543805 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3926250154592 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 144520531 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚492031603575808 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚492031603575808 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚18671328 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚4004.302874302 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚40346725 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚495971082757632 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚64900990 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚519 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚64900990 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚64900988 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚79619543 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4269878879232 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚79642815 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚427001740368896 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚18671847 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚427001563612160 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3925468672708 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 JDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚59033783 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚483841967315488 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 trainer/global_step‚3599 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚422845828535808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚496104900421632 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚79641231 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚64918442 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚64918440 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185132032 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚427116856410112 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _runtime‚4005.155606003 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 144582971 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚487769297254974 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚483841984354848 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚64918440 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚422845853439488 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3939762043904 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚79664529 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 144582971 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚79664529 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚496104099892224 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚59033783 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚483841967315488 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 trainer/global_step‚3599 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚422845828535808 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚496104900421632 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚79641231 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚64918442 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚64918440 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185132032 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚427116856410112 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _runtime‚4005.155606003 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 144582971 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚487769297254974 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚512 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚483841984354848 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚64918440 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚422845853439488 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 3939762043904 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚79664529 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 144582971 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚79664529 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚496104099892224 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 7 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.1993434727191925 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.6169642806053162 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.23051947355270386 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.1666666716337204 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.5403570532798767 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.3222222328186035 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.5237351655960083 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2293786257505417 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23786434531211853 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 7 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.2779761850833893 +jet/accuracy_3_of_5‚0.06889356672763824 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.4583333432674408 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.967886745929718 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5154767632484436 jet/accuracy_6_of_7‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 +"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.75 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.3804449737071991 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9985352158546448 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 *jet/accuracy_2_of_3‚0.2636568248271942 jet/accuracy_4_of_7‚0.5 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 *jet/accuracy_3_of_6‚0.2280701845884323 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 & Purity/4FRt*SRqqt*FBt/FRt_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.14402221143245697 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.06981480866670609 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 jet/accuracy_6_of_6‚0 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 particle/accuracy_5_of_5‚1 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.20000000298023224 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.49706000089645386 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.15833334624767303 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3730158805847168 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.9032922387123108 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9866377711296082 particle/accuracy_6_of_6‚1 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.24964486062526703 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.6052860021591187 9"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.4695468842983246 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.01433691754937172 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_3_of_7‚0.5 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 ) Purity/1FRt*SRqqt3FBt/FRt_purity‚0.75 jet/accuracy_5_of_5‚0 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 5 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.51335608959198 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1607142835855484 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8081851601600647 7 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.3022765517234802 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_2_of_5‚1 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9884300827980042 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7324561476707458 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 6 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.800000011920929 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.4767906665802002 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.31289011240005493 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.03578165918588638 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.015045139007270336 7 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.2152823805809021 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 particle/accuracy_1_of_7‚1 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2504578232765198 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3004128038883209 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7149122953414917 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.02896825410425663 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.008960573934018612 :"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.49735939502716064 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 jet/accuracy_2_of_7‚0.5 8"Purity/*FRt*SRqqt*FBt/event_purity‚0.252969354391098 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ;"Purity/2FRt1SRqqt0FBt/event_purity‚0.002481389557942748 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.3333333432674408 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.18117184937000275 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.3978571593761444 particle/accuracy_1_of_4‚1 +particle/specificity‚0.9506778717041016 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_6_of_7‚1 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.4583333432674408 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5778182148933411 :"Purity/2FRt*SRqqt2FBt/event_purity‚0.07888888567686081 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 _step‚293 9"Purity/0FRt2SRqqt0FBt/event_purity‚0.0682399794459343 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09238298237323761 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5155411958694458 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.5181992053985596 particle/accuracy_4_of_5‚1 ,"Purity/0FRt3SRqqt1FBt/event_purity‚0.125 trainer/global_step‚3623 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.12962962687015533 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2303806096315384 8"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.409722238779068 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9838137626647949 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ,particle/sensitivity‚0.32507821917533875 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4856255054473877 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_1_of_7‚1 jet/accuracy_7_of_7‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 ;"Purity/3FRt*SRqqt1FBt/event_purity‚0.054545458406209946 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.07664217054843903 9"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.4090135991573334 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9893462061882019 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.4912066161632538 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.2142857164144516 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.5008063316345215 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.4173611104488373 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.17655520141124725 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3207071125507355 particle/accuracy_3_of_5‚1 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.12356321513652802 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9806547164916992 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.42786577343940735 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5786023736000061 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.41111108660697937 8"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.632488489151001 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.43589746952056885 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3828125 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 *jet/accuracy_2_of_6‚0.5526315569877625 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8492063879966736 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.44051802158355713 & Purity/4FRt1SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.4347499907016754 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.03870728239417076 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.6888889074325562 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.18981480598449707 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_5‚1 particle/accuracy_2_of_6‚1 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.25098133087158203 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.21723809838294983 particle/accuracy_1_of_6‚1 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.4305555820465088 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1841122806072235 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.18761225044727325 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3160664141178131 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.4051917493343353 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.14000000059604645 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4761820435523987 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5510188341140747 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11136897653341293 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4971828758716583 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11650285869836807 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.20000000298023224 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.5000000596046448 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.17178131639957428 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5002777576446533 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/4FRt*SRqqt0FBt/FRt_purity‚0 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.3384384512901306 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.02458994835615158 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.17310425639152527 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 particle/accuracy_7_of_7‚1 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.006076715420931578 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.2916666865348816 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.19830194115638733 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.008064515888690948 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9957484006881714 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9893518686294556 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.19214028120040894 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 6 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.984610378742218 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9905165433883667 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4960941672325134 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 9"Purity/*FRt1SRqqt0FBt/event_purity‚0.2517482340335846 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.4551630914211273 <"Purity/2FRt1SRqqt*FBt/event_purity‚0.0032338914461433887 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 8"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.419809490442276 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.02500000037252903 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.05721950903534889 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 -"Purity/1FRt*SRqqt3FBt/event_purity‚0.1875 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.6666666865348816 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.008305761963129044 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5074372291564941 8 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.24967733025550842 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.800000011920929 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 6 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.986387312412262 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.4767906665802002 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.6301203966140747 ) Purity/1FRt0SRqqt3FBt/FRt_purity‚0.75 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6892856955528259 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9949451684951782 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5563867092132568 ;"Purity/1FRt2SRqqt0FBt/event_purity‚0.002810361795127392 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03030303120613098 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.1111111119389534 particle/accuracy_4_of_7‚1 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.7352941036224365 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.10420279204845428 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 9"Purity/1FRt0SRqqt2FBt/event_purity‚0.1550011932849884 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9920344352722168 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.4014016389846802 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 *jet/accuracy_2_of_2‚0.1161164939403534 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 8"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.515409529209137 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.49725082516670227 :"Purity/*FRt3SRqqt1FBt/event_purity‚0.02380952425301075 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9311111569404602 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 *jet/accur‡Ð/´Cacy_1_of_5‚0.9732598662376404 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.17128676176071167 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.003225806402042508 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5388438701629639 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.5041667222976685 jet/accuracy_5_of_6‚0 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.3214285671710968 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0032433902379125357 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.20494994521141052 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.4541667103767395 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 *"Purity/4FRt2SRqqt*FBt/SRqqt_purity‚0.5 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5642361044883728 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9894550442695618 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.47847893834114075 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.006086321081966162 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.7333333492279053 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6111098527908325 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.5096135139465332 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5450422167778015 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 *jet/accuracy_1_of_2‚0.7597037553787231 particle/accuracy_5_of_7‚1 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9867222309112549 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 )loss/val_total_loss‚38.97373352407561 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.39898988604545593 8"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.523809552192688 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.15015725791454315 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 7 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.1993464231491089 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 particle/accuracy_3_of_7‚1 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4394576847553253 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017844676971435547 *jet/accuracy_1_of_4‚0.9245014190673828 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.5146464705467224 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.20223814249038696 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9803623557090759 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.4585381746292114 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4923194646835327 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.07240740209817886 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 & Purity/4FRt1SRqqt0FBt/FRt_purity‚0 *"Purity/4FRt2SRqqt0FBt/SRqqt_purity‚0.5 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9996017217636108 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 particle/accuracy_3_of_4‚1 particle/accuracy_2_of_7‚1 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 ;"Purity/1FRt1SRqqt1FBt/event_purity‚0.039862263947725296 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.34375 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.2952171266078949 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5165356397628784 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ( Purity/3FRt0SRqqt1FBt/FRt_purity‚0.5 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9855698943138123 6 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.164338618516922 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 *jet/accuracy_1_of_3‚0.8758154511451721 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.800000011920929 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9972065091133118 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.11428571492433548 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.19277356564998627 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3576522469520569 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5092592835426331 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.20618928968906403 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3847593665122986 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5594688057899475 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9915174841880798 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 +jet/accuracy_2_of_4‚0.37644141912460327 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 8"Purity/0FRt*SRqqt2FBt/event_purity‚0.253131628036499 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ,jet/accuracy_4_of_5‚0.013568868860602379 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.36666667461395264 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 _runtime‚4072.795467587 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4096938669681549 (particle/accuracy‚0.8529696464538574 :"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.44925928115844727 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5371090769767761 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.21216198801994324 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.21934686601161957 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 jet/accuracy_1_of_6‚1 % _timestamp‚1.7884824206803887e+09 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9270833134651184 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 particle/accuracy_2_of_4‚1 9"Purity/*FRt*SRqqt2FBt/event_purity‚0.1914447546005249 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.46355462074279785 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 7validation_average_jet_accuracy‚0.43726733326911926 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5482142567634583 particle/accuracy_1_of_1‚1 'particle/f_score‚0.4084080755710602 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7163431644439697 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3824656307697296 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.23045267164707184 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3828125 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.18841344118118286 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.45214444398880005 +jet/accuracy_2_of_5‚0.44632047414779663 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.20223814249038696 particle/accuracy_2_of_2‚1 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_6‚1 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 8 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.29078182578086853 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 8"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.523809552192688 6 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.990334689617157 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.38362300395965576 particle/accuracy_1_of_2‚1 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.41447368264198303 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 particle/accuracy_2_of_3‚1 particle/accuracy_5_of_6‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 6 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.252155065536499 +jet/accuracy_3_of_3‚0.02844257839024067 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9933744668960571 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.6666666865348816 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9114943146705627 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.48045477271080017 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.022303126752376556 :"Purity/2FRt*SRqqt*FBt/event_purity‚0.01496379915624857 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.48975059390068054 7 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.9873272180557251 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9912605881690979 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 +"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.75 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.18433766067028046 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 particle/accuracy_4_of_4‚1 +jet/accuracy_4_of_6‚0.09649123251438141 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18217867612838745 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 6 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.925198495388031 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.4711398780345917 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 8"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.430014431476593 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.1111111119389534 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.5192307829856873 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 jet/accuracy_5_of_7‚0 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6208155155181885 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 +jet/accuracy_4_of_4‚0.01172488834708929 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 8"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.569050133228302 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.028421197086572647 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6474106311798096 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.15170428156852722 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.18343761563301086 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.16524575650691986 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.3888888657093048 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 epoch‚5 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3822087347507477 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.5307970643043518 )jet/accuracy_1_of_1‚0.477161169052124 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.20000000298023224 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.2729646563529968 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4632455110549927 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.043217889964580536 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5699924230575562 8"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.505998969078064 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943[ž{><ŽÕ¨ ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09238298237323761 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5155411958694458 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.5181992053985596 particle/accuracy_4_of_5‚1 ,"Purity/0FRt3SRqqt1FBt/event_purity‚0.125 trainer/global_step‚3623 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.12962962687015533 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2303806096315384 8"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.409722238779068 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9838137626647949 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ,particle/sensitivity‚0.32507821917533875 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 *"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.5 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.4856255054473877 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_1_of_7‚1 jet/accuracy_7_of_7‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 ;"Purity/3FRt*SRqqt1FBt/event_purity‚0.054545458406209946 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.07664217054843903 9"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.4090135991573334 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9893462061882019 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.4912066161632538 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.2142857164144516 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.5008063316345215 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.4173611104488373 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.17655520141124725 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3207071125507355 particle/accuracy_3_of_5‚1 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.12356321513652802 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9806547164916992 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.42786577343940735 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5786023736000061 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.41111108660697937 8"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.632488489151001 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.43589746952056885 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3828125 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 *jet/accuracy_2_of_6‚0.5526315569877625 7 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.8492063879966736 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.44051802158355713 & Purity/4FRt1SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.4347499907016754 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.03870728239417076 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.6888889074325562 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.18981480598449707 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_5‚1 particle/accuracy_2_of_6‚1 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 8 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.25098133087158203 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.21723809838294983 particle/accuracy_1_of_6‚1 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.4305555820465088 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 9"Purity/*FRt*SRqqt0FBt/event_purity‚0.1841122806072235 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.18761225044727325 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3160664141178131 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.4051917493343353 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.14000000059604645 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4761820435523987 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5510188341140747 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11136897653341293 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4971828758716583 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11650285869836807 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.20000000298023224 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.5000000596046448 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.17178131639957428 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5002777576446533 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/4FRt*SRqqt0FBt/FRt_purity‚0 7 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.3384384512901306 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.02458994835615158 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.17310425639152527 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 particle/accuracy_7_of_7‚1 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.006076715420931578 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.2916666865348816 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.19830194115638733 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.008064515888690948 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9957484006881714 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9893518686294556 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.19214028120040894 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 6 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.984610378742218 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9905165433883667 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4960941672325134 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 9"Purity/*FRt1SRqqt0FBt/event_purity‚0.2517482340335846 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 9"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.4551630914211273 <"Purity/2FRt1SRqqt*FBt/event_purity‚0.0032338914461433887 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 8"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.419809490442276 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.02500000037252903 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.05721950903534889 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 -"Purity/1FRt*SRqqt3FBt/event_purity‚0.1875 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.6666666865348816 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.008305761963129044 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5074372291564941 8 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.24967733025550842 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.800000011920929 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 6 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.986387312412262 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.4767906665802002 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.6301203966140747 ) Purity/1FRt0SRqqt3FBt/FRt_purity‚0.75 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6892856955528259 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9949451684951782 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5563867092132568 ;"Purity/1FRt2SRqqt0FBt/event_purity‚0.002810361795127392 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03030303120613098 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.1111111119389534 particle/accuracy_4_of_7‚1 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.7352941036224365 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.10420279204845428 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 9"Purity/1FRt0SRqqt2FBt/event_purity‚0.1550011932849884 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9920344352722168 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.4014016389846802 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 *jet/accuracy_2_of_2‚0.1161164939403534 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 8"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.515409529209137 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.49725082516670227 :"Purity/*FRt3SRqqt1FBt/event_purity‚0.02380952425301075 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9311111569404602 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 *jet/accuracy_1_of_5‚0.9732598662376404 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.17128676176071167 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.003225806402042508 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 9"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.5388438701629639 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.5041667222976685 jet/accuracy_5_of_6‚0 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.3214285671710968 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0032433902379125357 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.20494994521141052 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.4541667103767395 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 *"Purity/4FRt2SRqqt*FBt/SRqqt_purity‚0.5 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5642361044883728 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9894550442695618 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.47847893834114075 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.006086321081966162 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.7333333492279053 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6111098527908325 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.5096135139465332 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5450422167778015 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 *jet/accuracy_1_of_2‚0.7597037553787231 particle/acc{ÿ{XXuracy_5_of_7‚1 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9867222309112549 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 *"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.5 )loss/val_total_loss‚38.97373352407561 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.39898988604545593 8"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.523809552192688 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.15015725791454315 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 7 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.1993464231491089 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 particle/accuracy_3_of_7‚1 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4394576847553253 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017844676971435547 *jet/accuracy_1_of_4‚0.9245014190673828 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.5146464705467224 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.20223814249038696 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9803623557090759 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.4585381746292114 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.8809523582458496 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4923194646835327 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.07240740209817886 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 & Purity/4FRt1SRqqt0FBt/FRt_purity‚0 *"Purity/4FRt2SRqqt0FBt/SRqqt_purity‚0.5 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9996017217636108 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 particle/accuracy_3_of_4‚1 particle/accuracy_2_of_7‚1 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 ;"Purity/1FRt1SRqqt1FBt/event_purity‚0.039862263947725296 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.34375 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.2952171266078949 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5165356397628784 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ( Purity/3FRt0SRqqt1FBt/FRt_purity‚0.5 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9855698943138123 6 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.164338618516922 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 *jet/accuracy_1_of_3‚0.8758154511451721 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.800000011920929 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9972065091133118 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.11428571492433548 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.19277356564998627 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3576522469520569 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.5092592835426331 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.20618928968906403 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3847593665122986 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5594688057899475 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9915174841880798 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 +jet/accuracy_2_of_4‚0.37644141912460327 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 8"Purity/0FRt*SRqqt2FBt/event_purity‚0.253131628036499 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ,jet/accuracy_4_of_5‚0.013568868860602379 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.36666667461395264 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 _runtime‚4072.795467587 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4096938669681549 (particle/accuracy‚0.8529696464538574 :"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.44925928115844727 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5371090769767761 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.21216198801994324 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.21934686601161957 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 jet/accuracy_1_of_6‚1 % _timestamp‚1.7884824206803887e+09 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9270833134651184 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 particle/accuracy_2_of_4‚1 9"Purity/*FRt*SRqqt2FBt/event_purity‚0.1914447546005249 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.46355462074279785 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 7validation_average_jet_accuracy‚0.43726733326911926 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5482142567634583 particle/accuracy_1_of_1‚1 'particle/f_score‚0.4084080755710602 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7163431644439697 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3824656307697296 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.23045267164707184 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3828125 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.18841344118118286 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.45214444398880005 +jet/accuracy_2_of_5‚0.44632047414779663 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.20223814249038696 particle/accuracy_2_of_2‚1 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 particle/accuracy_3_of_6‚1 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 8 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.29078182578086853 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 8"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.523809552192688 6 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.990334689617157 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.38362300395965576 particle/accuracy_1_of_2‚1 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.41447368264198303 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 particle/accuracy_2_of_3‚1 particle/accuracy_5_of_6‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 6 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.252155065536499 +jet/accuracy_3_of_3‚0.02844257839024067 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9933744668960571 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.6666666865348816 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9114943146705627 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.48045477271080017 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.022303126752376556 :"Purity/2FRt*SRqqt*FBt/event_purity‚0.01496379915624857 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.48975059390068054 7 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.9873272180557251 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9912605881690979 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 +"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.75 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.18433766067028046 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 particle/accuracy_4_of_4‚1 +jet/accuracy_4_of_6‚0.09649123251438141 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18217867612838745 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 6 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.925198495388031 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.4711398780345917 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 8"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.430014431476593 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.1111111119389534 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.5192307829856873 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 jet/accuracy_5_of_7‚0 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6208155155181885 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 +jet/accuracy_4_of_4‚0.01172488834708929 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 8"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.569050133228302 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.028421197086572647 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6474106311798096 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.15170428156852722 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.18343761563301086 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.16524575650691986 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.3888888657093048 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 epoch‚5 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3822087347507477 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.5307970643043518 )jet/accuracy_1_of_1‚0.477161169052124 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.20000000298023224 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.2729646563529968 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4632455110549927 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.043217889964580536 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5699924230575562 8"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.505998969078064 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9876488447189331 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.39487120509147644 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 7 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.1993434727191925 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.6169642806053162 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.23051947355270386 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.1666666716337204 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.5403570532798767 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.3222222328186035 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.5237351655960083 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2293786257505417 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23786434531211853 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 7 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.2779761850833893 +jet/accuracy_3_of_5‚0.06889356672763824 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.4583333432674408 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.967886745929718 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5154767632484436 jet/accuracy_6_of_7‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 +"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.75 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.3804449737071991 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9985352158546448 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 *jet/accuracy_2_of_3‚0.2636568248271942 jet/accuracy_4_of_7‚0.5 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 *jet/accuracy_3_of_6‚0.2280701845884323 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 & Purity/4FRt*SRqqt*FBt/FRt_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.14402221143245697 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.06981480866670609 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 jet/accuracy_6_of_6‚0 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 particle/accuracy_5_of_5‚1 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.20000000298023224 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.49706000089645386 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.15833334624767303 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3730158805847168 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.9032922387123108 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9866377711296082 particle/accuracy_6_of_6‚1 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.24964486062526703 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.6052860021591187 9"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.4695468842983246 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.01433691754937172 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_3_of_7‚0.5 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 ) Purity/1FRt*SRqqt3FBt/FRt_purity‚0.75 jet/accuracy_5_of_5‚0 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 5 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.51335608959198 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1607142835855484 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8081851601600647 7 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.3022765517234802 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_2_of_5‚1 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9884300827980042 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7324561476707458 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 6 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.800000011920929 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.4767906665802002 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.31289011240005493 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.03578165918588638 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.015045139007270336 7 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.2152823805809021 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 particle/accuracy_1_of_7‚1 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2504578232765198 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3004128038883209 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7149122953414917 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.02896825410425663 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.008960573934018612 :"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.49735939502716064 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 jet/accuracy_2_of_7‚0.5 8"Purity/*FRt*SRqqt*FBt/event_purity‚0.252969354391098 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ;"Purity/2FRt1SRqqt0FBt/event_purity‚0.002481389557942748 7 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.3333333432674408 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.18117184937000275 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.3978571593761444 particle/accuracy_1_of_4‚1 +particle/specificity‚0.9506778717041016 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 particle/accuracy_6_of_7‚1 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.4583333432674408 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5778182148933411 :"Purity/2FRt*SRqqt2FBt/event_purity‚0.07888888567686081 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 _step‚293 9"Purity/0FRt2SRqqt0FBt/event_purity‚0.0682399794459343 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1¥‹×ë‚“‚(:ˆ û¦èÔ­±®¬ gpu.0.gpu‚88.0 gpu.0.memory‚22, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚116.916' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.229 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0·Úš4_‚(:Ô û¦èÔèöϬ network.recv‚ 1.369265e+06 disk.nvme0n1.in‚ 220.8671875! disk.nvme0n1.out‚ 28662.953125 disk.sdb2.in‚9.4375 disk.rbd2.out‚1.0625 disk.sda1.in‚0# memory_percent‚89.2071008682251 disk.md0.out‚ 456.1328125 disk.dm-0.out‚ 52126.84375 disk.sda1.out‚0) proc.memory.availableMB‚ 1768.30859375 proc.cpu.threads‚17 disk.sda2.in‚ 57.765625! disk.sda2.out‚473.46533203125 network.sent‚ 7.816374e+06 disk.sdb.in‚9.4375 disk.sda.out‚473.46533203125 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 456.1328125 disk.rbd2.in‚0 cpu‚25.761056181793318) disk./.usagePercent‚83.21889689288484! disk.nvme1n1.out‚ 23463.890625 disk.rbd0.out‚ 0.900390625# proc.memory.rssMB‚ 3087.03515625 disk.sdb.out‚473.46533203125 disk.md0.in‚ 67.203125 disk.sdb1.in‚0 disk.sda.in‚ 57.765625 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875) proc.memory.percent‚18.84176731109619% disk./.usageGB‚2976.3108444213867! disk.sdb2.out‚473.46533203125 disk.md0p1.in‚ 67.203125 disk.sdb1.out‚0&¹U»‘‚(:„ Š§èÔڨح gpu.0.gpu‚84.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚220.8' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.2 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ouCæY’‚(:Î Š§èÔقű disk.sdb.out‚ 475.33203125 proc.cpu.threads‚17 disk.md0p1.out‚ 457.93359375 disk.sda.in‚ 57.765625 disk.sda1.out‚0! disk.nvme0n1.out‚ 28690.578125) proc.memory.availableMB‚ 1768.28515625) proc.memory.percent‚18.84176731109619 cpu‚25.75992354217276 network.sent‚ 7.920194e+06) disk./.usagePercent‚83.22763388371305 disk.md0p1.in‚ 67.203125 disk.rbd0.in‚0 disk.sda2.in‚ 57.765625 disk.sdb2.out‚ 475.33203125 network.recv‚ 1.373837e+06 disk.rbd2.in‚0 disk.rbd2.out‚1.0625 disk.sda.out‚ 475.33203125 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb1.in‚0# proc.memory.rssMB‚ 3087.03515625$ disk./.usageGB‚2976.623321533203 disk.dm-0.out‚52274.56640625 disk.sda2.out‚ 475.33203125 disk.md0.in‚ 67.203125 disk.sdb2.in‚9.4375 disk.rbd0.out‚ 0.900390625 disk.nvme0n1.in‚ 220.8671875 disk.md0.out‚ 457.93359375$ memory_percent‚89.20724391937256 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0# disk.nvme1n1.out‚23583.98828125 disk.sdb.in‚9.4375 Ýy2“- _wandbruntime‚4105  _runtime‚4105¬!…dɔà _step‚294 ' lr-AdamW/pg1‚0.00048575330726853934 ' lr-AdamW/pg2‚0.00048575330726853934 trainer/global_step‚3649 % _timestamp‚1.7884824531985128e+09 _runtime‚4105.3117804368 h¬Î•È ' lr-AdamW/pg1‚0.00048575330726853934 ' lr-AdamW/pg2‚0.00048575330726853934 trainer/global_step‚3649 % _timestamp‚1.7884824531985128e+09 _runtime‚4105.311780436 _step‚294¦„¹v¦2–- _wandbruntime‚4105  _runtime‚4105Ê\Ç—ìO [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4348029734400 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚80969016 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚430789875340288 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚496908634943146 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚60261358 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3998158613950 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚41206440 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚505498553419776 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚492909694847312 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚4105.312182037 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚66186510 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚60260832 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚19054915 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4011614469120 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚526 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚496907836421902 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3998940095834 G?DeviceëÇ +StatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚430789850436608 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚66186510 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚523 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚19054392 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚505497752903680 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚80992288 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚501486155473920 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4012397945856 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 147178798 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚492909677807952Ð ³H÷'˜ñO WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4011614469120 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚501486155473920 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚435137728317952 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚41206440 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚505498553419776 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚492909694847312 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚4105.312182037 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚66186510 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚60260832 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚19054915 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4011614469120 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚526 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚496907836421902 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 3998940095834 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚430789850436608 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚66186510 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚523 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚19054392 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚505497752903680 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚80992288 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚501486155473920 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4012397945856 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 147178798 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚492909677807952 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4348029734400 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚80969016 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚430789875340288 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚496908634943146 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚60261358 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 3998158613950 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚430903994239488 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚497039549368268 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚505632371083776 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚501618889746432 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3999221359276 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 147217964 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚81014002 % _timestamp‚1.7884824542054932e+09 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚60277069 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 164422656 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚60276539 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚497040347889720 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚80990704 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 147194664 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚435253010147328 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚501618906785792 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 trainer/global_step‚3649 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚501618889746432 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4012680807936 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚527 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚493040328008992 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4013464297984 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚41217200 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚19059866 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚296 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚435253199473664 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 _runtime‚ 4106.31692176 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚430904019143168 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4349180330496 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19059339 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚501618906785792 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 147194664 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189326336 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4000002841368 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚66203962 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚66203960 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚505632371083776 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚66203962 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4012680807936 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 147217964 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚493040345048352 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚430903994239488 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚497039549368268 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚505632371083776 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚501618889746432 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 3999221359276 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 147217964 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚81014002 % _timestamp‚1.7884824542054932e+09 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚60277069 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 164422656 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚60276539 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚497040347889720 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚80990704 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 147194664 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚435253010147328 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚501618906785792 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 trainer/global_step‚3649 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚501618889746432 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4012680807936 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚527 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚493040328008992 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4013464297984 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚41217200 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚19059866 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚296 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚435253199473664 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 _runtime‚ 4106.31692176 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚430904019143168 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4349180330496 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19059339 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚501618906785792 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 147194664 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189326336 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4000002841368 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚66203962 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚66203960 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚505632371083776 PBDeviceStatsMon2’­1ritor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚66203962 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4012680807936 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 147217964 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚493040345048352 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400¨ðô2œ- _wandbruntime‚4106  _runtime‚4106§toVÐ 0loss/FRt3/assignment_loss‚3.0352388220173974 1loss/SRqqt1/detection_loss‚0.8896163431451704 /loss/FRt1/assignment_loss‚1.230285668745637 2loss/SRqqt1/assignment_loss‚1.0605114417653667 1loss/SRqqt2/detection_loss‚1.2082437901374172 /loss/FBt4/detection_loss‚2.2343353991923123 _runtime‚4106.318449267 2loss/SRqqt3/assignment_loss‚1.7083161125173334 1loss/FBt4/assignment_loss‚0.28707660885706704 .loss/FBt3/detection_loss‚2.544930662959814 epoch‚6 % _timestamp‚1.7884824542080054e+09 0loss/FRt2/assignment_loss‚2.2228010098139444 0loss/FBt2/assignment_loss‚0.1138924072127136 0loss/FBt3/assignment_loss‚0.6499679783008787 0loss/SRqqt3/detection_loss‚2.438213430955762 0loss/SRqqt4/detection_loss‚2.210600271821022 /loss/FBt1/detection_loss‚0.6304338867531011 /loss/FRt4/assignment_loss‚2.901367543691612 /loss/FRt3/detection_loss‚2.6122171895844595 /loss/FBt2/detection_loss‚1.5323145742769595 _step‚297 1loss/SRqqt2/assignment_loss‚1.432922543598692 2loss/SRqqt4/assignment_loss‚1.5541009278701885 .loss/FRt2/detection_loss‚2.045685747289099 .loss/FRt4/detection_loss‚2.189305404225695 #loss/total_loss‚38.416013063672 1loss/FBt1/assignment_loss‚0.10781324589004233 .loss/FRt1/detection_loss‚1.575822053050312 trainer/global_step‚3649ëí‘[žÕ 1loss/SRqqt2/detection_loss‚1.2082437901374172 /loss/FBt4/detection_loss‚2.2343353991923123 _runtime‚4106.318449267 2loss/SRqqt3/assignment_loss‚1.7083161125173334 1loss/FBt4/assignment_loss‚0.28707660885706704 .loss/FBt3/detection_loss‚2.544930662959814 epoch‚6 % _timestamp‚1.7884824542080054e+09 0loss/FRt2/assignment_loss‚2.2228010098139444 0loss/FBt2/assignment_loss‚0.1138924072127136 0loss/FBt3/assignment_loss‚0.6499679783008787 0loss/SRqqt3/detection_loss‚2.438213430955762 0loss/SRqqt4/detection_loss‚2.210600271821022 /loss/FBt1/detection_loss‚0.6304338867531011 /loss/FRt4/assignment_loss‚2.901367543691612 /loss/FRt3/detection_loss‚2.6122171895844595 /loss/FBt2/detection_loss‚1.5323145742769595 _step‚297 1loss/SRqqt2/assignment_loss‚1.432922543598692 2loss/SRqqt4/assignment_loss‚1.5541009278701885 .loss/FRt2/detection_loss‚2.045685747289099 .loss/FRt4/detection_loss‚2.189305404225695 #loss/total_loss‚38.416013063672 1loss/FBt1/assignment_loss‚0.10781324589004233 .loss/FRt1/detection_loss‚1.575822053050312 trainer/global_step‚3649 0loss/FRt3/assignment_loss‚3.0352388220173974 1loss/SRqqt1/detection_loss‚0.8896163431451704 /loss/FRt1/assignment_loss‚1.230285668745637 2loss/SRqqt1/assignment_loss‚1.0605114417653667©œüGt•Ÿ‚(:Š ™§èÔû›ª¬ gpu.0.gpu‚87.0 gpu.0.memory‚22, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚128.665' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚32.16625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ÿá[d ‚(:Ù ™§èԥΔ® disk.rbd2.out‚1.0625 disk.sda.out‚476.84912109375 disk.sda1.in‚0# disk.nvme1n1.out‚23680.54296875 disk.sdb.in‚9.4375 disk.sdb.out‚476.84912109375$ disk./.usageGB‚2976.808940887451 disk.md0.out‚ 459.39453125 disk.sdb2.in‚9.4375 cpu‚25.758664830327323 proc.cpu.threads‚17 disk.rbd2.in‚0# disk.nvme0n1.out‚29354.26953125# proc.memory.rssMB‚ 3087.03515625) proc.memory.percent‚18.84176731109619) disk./.usagePercent‚83.23282387854557 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.sdb1.in‚0! disk.sda2.out‚476.84912109375$ memory_percent‚89.20843601226807 network.sent‚ 7.937658e+06 network.recv‚ 1.379106e+06 disk.dm-0.out‚ 53034.8125! disk.sdb2.out‚476.84912109375 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 0.900390625 disk.sda.in‚ 57.765625 disk.sda1.out‚0 disk.sda2.in‚ 57.765625 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0) proc.memory.availableMB‚ 1768.08984375 disk.md0p1.out‚ 459.39453125 disk.rbd0.in‚0ôdJP•¡‚(:Š ¨§èÔóîÑ« gpu.0.gpu‚61.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚198.797' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚49.69925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0>âQèg¢‚(:Ü ¨§èÔÃúð« disk.nvme1n1.in‚ 32.45703125 disk.sdb1.out‚0 disk.sda.in‚ 57.765625 disk.sda1.in‚0# proc.memory.rssMB‚ 3087.03515625 disk.md0.out‚ 460.97265625 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 460.97265625 disk.rbd0.in‚0 disk.rbd0.out‚ 0.900390625 disk.sdb1.in‚0 disk.sda1.out‚0 disk.dm-0.out‚53283.33984375 cpu‚25.757401535949082 proc.cpu.threads‚17 network.recv‚ 1.383447e+06 disk.sdb.out‚478.48095703125! disk.sda2.out‚478.48095703125 disk.rbd2.in‚0 disk.rbd2.out‚1.0625 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚23824.58203125) disk./.usagePercent‚83.24684760530893 disk.md0.in‚ 67.203125 network.sent‚ 8.010639e+06 disk.sdb.in‚9.4375 disk.sda2.in‚ 57.765625$ memory_percent‚89.20693397521973% disk./.usageGB‚2977.3104972839355 disk.sda.out‚478.48095703125 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875( proc.memory.availableMB‚ 1768.3359375" disk.nvme0n1.out‚ 29458.7578125! disk.sdb2.out‚478.48095703125) proc.memory.percent‚18.84176731109619gGÏØ“£‚(:ˆ ·§èÔÍ…ö© gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚04ut®`¤‚(:Õ ·§èÔ¿‘£« network.sent‚ 8.017082e+06 network.recv‚ 1.387959e+06) disk./.usagePercent‚83.24677432952336 disk.sdb1.in‚0 disk.sda.out‚480.5673828125 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375# disk.nvme1n1.out‚23968.74609375 disk.sdb.out‚480.5673828125 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125 disk.dm-0.in‚ 253.32421875# proc.memory.rssMB‚ 3087.03515625) proc.memory.percent‚18.84176731109619 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb2.out‚480.5673828125 disk.md0.in‚ 67.203125$ disk./.usageGB‚2977.307876586914 disk.sda.in‚ 57.765625 disk.nvme0n1.out‚ 29586.0625 disk.md0p1.out‚ 463.00390625 disk.rbd2.in‚0 disk.rbd2.out‚1.0625 disk.nvme0n1.in‚ 220.8671875 disk.md0.out‚ 463.00390625 disk.rbd0.in‚0 disk.dm-0.out‚53554.80859375 disk.sdb1.out‚0 disk.rbd0.out‚ 0.900390625$ memory_percent‚89.20872211456299) proc.memory.availableMB‚ 1768.04296875 proc.cpu.threads‚17 disk.sda2.out‚480.5673828125 cpu‚25.756125809294463]°Ë„“¥‚(:ˆ ƧèÔÙè© gpu.0.gpu‚73.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚128.056' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚32.014 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚07ža!b¦‚(:× ƧèÔηûª cpu‚25.755153424170988 disk.md0p1.in‚ 67.203125 disk.rbd0.in‚0 disk.sdb2.in‚9.4375! disk.sda2.out‚482.13134765625 disk.md0.out‚ 464.515625 disk.md0p1.out‚ 464.515625! disk.nvme0n1.out‚ 29634.265625% disk./.usageGB‚2977.3097190856934 disk.sdb1.in‚0 disk.sda.out‚482.13134765625 disk.rbd2.out‚1.0625 disk.sdb1.out‚0 disk.sda.in‚ 57.765625 disk.rbd0.out‚ 0.900390625 disk.sdb.in‚9.4375 network.recv‚ 1.391467e+06 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚482.13134765625 disk.sda2.in‚ 57.765625 disk.dm-0.in‚ 253.32421875$ memory_percent‚89.20893669128418) proc.memory.percent‚18.84176731109619 network.sent‚ 8.022206e+06! disk.sdb2.out‚482.13134765625 disk.md0.in‚ 67.203125# proc.memory.rssMB‚ 3087.03515625 proc.cpu.threads‚17 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚24112.86328125 disk.dm-0.out‚53747.12890625 disk.rbd2.in‚0) disk./.usagePercent‚83.24682584656038( proc.memory.availableMB‚ 1768.0078125ñöKq2§- _wandbruntime‚4159  _runtime‚4159½¤È¨Â _step‚298 ' lr-AdamW/pg1‚0.00046882707756973335 ' lr-AdamW/pg2‚0.00046882707756973335 trainer/global_step‚3699 % _timestamp‚1.7884825071604235e+09 _runtime‚ 4159.27079544ߌÍ©Ç % _timestamp‚1.7884825071604235e+09 _runtime‚ 4159.27079544 _step‚298 ' lr-AdamW/pg1‚0.00046882707756973335 ' lr-AdamW/pg2‚0.00046882707756973335 trainer/global_step‚3699ªs2ª- _wandbruntime‚4159  _runtime‚4159zÛŽò'«ìO aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚436497040580608 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚512189463782400 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚512188663266304 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 149139150 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚499442187859952 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4052104534142 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚67059110 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚61046921 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _runtime‚4159.271653064 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4065742714880 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚41744440 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚503493510912210 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚67059110 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚516 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 149115876 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 trainer/global_step‚3699 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚512189463782400 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚508123721067520 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚513 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚19301965 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚19302478 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚440902871823360 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 _step‚299 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚82080040 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4051323052258 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884825071612272e+09 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4405652388864 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4065742714880 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚82056768 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚440902692969472 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚512188663266304 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚508123704028160 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0ýæ‡÷'¬ñO GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚440902871823360 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 _step‚299 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚82080040 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4051323052258 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884825071612272e+09 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4405652388864 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4065742714880 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚82056768 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚440902692969472 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚512188663266304 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚508123704028160 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚436497040580608 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚512189463782400 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚512188663266304 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 149139150 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚499442187859952 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4052104534142 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚67059110 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚61046921 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _runtime‚4159.271653064 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4065742714880 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚41744440 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚503493510912210 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚67059110 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚516 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 149115876 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 trainer/global_step‚3699 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚512189463782400 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚508123721067520 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚513 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚19301965 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚19302478 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785«øG>Ä2­- _wandbruntime‚4160  _runtime‚4160…].®õM OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19306889 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚436611209287168 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚67076562 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚67076560 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚533 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚82101754 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚61062625 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚50362602238002QÉàÍ 8 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 149178316 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚499572838060992 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4066809067008 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚508256455340032 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4066809067008 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 149155016 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4066025576960 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚441017996103680 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚82078456 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4406811720192 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚41755200 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _runtime‚4160.182943621 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 149178316 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚508256455340032 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 trainer/global_step‚3699 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚61062089 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4052385797584 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4066025576960 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 149155016 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚436611184383488 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 _step‚300 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408pŠûS'¯úM REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚82101754 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚499572855100352 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚67076560 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚536 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚503625223858576 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _runtime‚4160.182943621 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 149178316 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚508256455340032 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 trainer/global_step‚3699 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚61062089 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4052385797584 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4066025576960 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 149155016 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚436611184383488 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 _step‚300 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19306889 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚436611209287168 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚67076562 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚67076560 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚533 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚82101754 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚61062625 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚503626022380028 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 149178316 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚499572838060992 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4066809067008 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚508256455340032 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4066809067008 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 149155016 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4066025576960 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚441017996103680 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚82078456 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4406811720192 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚41755200 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 EDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚518880374145024 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4118304007168 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚446667873958912 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚518880374145024 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚61832039 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚446667697202176 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4104487490566 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 trainer/global_step‚3749 _step‚303 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 % _timestamp‚1.7884825610828063e+09 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚4213.193563649 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚508 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚67931710 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚505974714951312 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚518879573628928 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_star²Ø.ßút/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚514761286661120 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚61832550 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4118304007168 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚510079185402518 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚67931710 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚42282443 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚67931708 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚442204255628288 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚518879573628928 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚442204230724608 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4119087483904 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4105268972450 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 151099502 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4463466477568 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚83167792 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚42282440 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚19549599 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚510079983923762 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚83144520 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0VÌ·t÷'¾ñO KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚19550107 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚67931708 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚514761286661120 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚514761269621760 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚518880374145024 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4118304007168 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚446667873958912 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚518880374145024 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚61832039 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚446667697202176 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4104487490566 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 trainer/global_step‚3749 _step‚303 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 % _timestamp‚1.7884825610828063e+09 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚4213.193563649 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚508 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚67931710 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚505974714951312 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚518879573628928 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚514761286661120 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚61832550 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4118304007168 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚510079185402518 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚67931710 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚42282443 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚67931708 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚442204255628288 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚518879573628928 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚442204230724608 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4119087483904 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4105268972450 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 151099502 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4463466477568 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚83167792 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚42282440 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚19549599 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚510079983923762 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚83144520 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 151076228 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4463618330624 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309¯$ïXÍ2¿- _wandbruntime‚4214  _runtime‚4214@ÑYü&ÀöM H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 151115368 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 % _timestamp‚1.7884825620311475e+09 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚83166208 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚19555085 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 151115368 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚532 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19554553 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4464782521344 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚61847753 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 _step‚304 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4119370345984 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚510211696870336 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚506105348112992 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 151138668 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚67949162 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚61848288 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚42293200 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚4214.142208918 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 151138668 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4106331717984 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚514894020933632 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚535 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚510210898348884 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚514894037972992 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚67949162 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4120153836032 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4464628584448 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4120153836032 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚42293203 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚67949160 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚519014191809024 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚67949160 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚83166208 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚442318399431168 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4120153836032 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4464628584448 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4120153836032 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚42293203 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚67949160 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚519014191809024 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚67949160 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚83166208 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚442318399431168 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 % _timestamp‚1.7884825620311475e+09 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚83166208 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚19555085 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 151115368 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚532 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19554553 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4464782521344 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚61847753 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 _step‚304 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4119370345984 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚510211696870336 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚506105348112992 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 151138668 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚67949162 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚61848288 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚42293200 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚4214.142208918 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 151138668 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4106331717984 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚514894020933632 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚535 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚510210898348884 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752°WÉÎ2Â- _wandbruntime‚4214  _runtime‚4214ÏË ^ÃØ 0loss/FRt2/assignment_loss‚1.8458460234105587 /loss/FRt4/assignment_loss‚3.118445042000022 2loss/SRqqt3/assignment_loss‚1.7830023594311815 1loss/FBt3/assignment_loss‚0.30114134331821474 /loss/FRt3/detection_loss‚3.0965234899520873 /loss/FRt4/detection_loss‚2.1745701657260157 0loss/FRt1/assignment_loss‚1.5195206980755989 %loss/total_loss‚38.09846405877259 2loss/SRqqt2/assignment_loss‚1.1990087827204898 2loss/SRqqt4/assignment_loss‚1.6674542744008323 0loss/FBt4/assignment_loss‚0.3671384873955701 1loss/SRqqt1/detection_loss‚1.0926148287889337 1loss/SRqqt3/detection_loss‚2.2289170720683993 1loss/SRqqt4/detection_loss‚2.2241718471050262 /loss/FBt2/detection_loss‚1.3019423701223873 /loss/FRt1/detection_loss‚1.7914763315025954 2loss/SRqqt1/assignment_loss‚0.8260252567540322 /loss/FRt3/assignment_loss‚2.801265003681183 1loss/FBt1/assignment_loss‚0.10058637967618983 1loss/FBt2/assignment_loss‚0.07326056119995883 /loss/FBt3/detection_loss‚2.2920708633386173 trainer/global_step‚3749 _step‚305 /loss/FRt2/detection_loss‚1.9213831422384828 /loss/SRqqt2/detection_loss‚1.12466379888593 /loss/FBt1/detection_loss‚0.7083491442002812 % _timestamp‚1.7884825620331156e+09 /loss/FBt4/detection_loss‚2.5390867927800054 epoch‚6 _runtime‚4214.143214833Oès¥cÄÝ /loss/FRt3/assignment_loss‚2.801265003681183 1loss/FBt1/assignment_loss‚0.10058637967618983 1loss/FBt2/assignment_loss‚0.07326056119995883 /loss/FBt3/detection_loss‚2.2920708633386173 trainer/global_step‚3749 _step‚305 /loss/FRt2/detection_loss‚1.9213831422384828 /loss/SRqqt2/detection_loss‚1.12466379888593 /loss/FBt1/detection_loss‚0.7083491442002812 % _timestamp‚1.7884825620331156e+09 /loss/FBt4/detection_loss‚2.5390867927800054 epoch‚6 _runtime‚4214.143214833 0loss/FRt2/assignment_loss‚1.8458460234105587 /loss/FRt4/assignment_loss‚3.118445042000022 2loss/SRqqt3/assignment_loss‚1.7830023594311815 1loss/FBt3/assignment_loss‚0.30114134331821474 /loss/FRt3/detection_loss‚3.0965234899520873 /loss/FRt4/detection_loss‚2.1745701657260157 0loss/FRt1/assignment_loss‚1.5195206980755989 %loss/total_loss‚38.09846405877259 2loss/SRqqt2/assignment_loss‚1.1990087827204898 2loss/SRqqt4/assignment_loss‚1.6674542744008323 0loss/FBt4/assignment_loss‚0.3671384873955701 1loss/SRqqt1/detection_loss‚1.0926148287889337 1loss/SRqqt3/detection_loss‚2.2289170720683993 1loss/SRqqt4/detection_loss‚2.2241718471050262 /loss/FBt2/detection_loss‚1.3019423701223873 /loss/FRt1/detection_loss‚1.7914763315025954 2loss/SRqqt1/assignment_loss‚0.8260252567540322±«ÏþJDÅ‚(:¹ ‚¨èÔÉûÝ­ disk.sdb2.out‚488.875 disk.sda2.out‚488.875 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda.out‚488.875 disk.sda1.in‚0( proc.memory.availableMB‚ 1767.8828125 network.recv‚ 1.408832e+06) disk./.usagePercent‚83.23986400696826 disk.md0.in‚ 67.203125" disk.nvme1n1.out‚ 24760.4140625 cpu‚25.750752886254986 disk.rbd2.out‚1.0625 network.sent‚ 8.126412e+06% disk./.usageGB‚2977.0607299804688 disk.sdb2.in‚9.4375 disk.sda2.in‚ 57.765625 disk.md0.out‚ 471.0390625 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.sdb.out‚488.875 disk.nvme1n1.in‚ 32.45703125# memory_percent‚89.2096996307373) proc.memory.percent‚18.84176731109619 disk.md0p1.out‚ 471.0390625 disk.sdb.in‚9.4375 disk.rbd0.out‚ 0.900390625 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚29809.05078125 proc.cpu.threads‚17 disk.dm-0.out‚54569.46484375 disk.sdb1.in‚0 disk.sda.in‚ 57.765625 disk.md0p1.in‚ 67.203125# proc.memory.rssMB‚ 3087.03515625Üè’ŸÆ‚(:” ‚¨èÔ„²¸¬ gpu.0.gpu‚72.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚214.281' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚53.570249999999994 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ª‹#•Ç‚(:Š ‘¨èÔ‚« gpu.0.gpu‚73.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚123.435' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.85875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0<ÛD`È‚(:Õ ‘¨èÔÎÁ“¬) disk./.usagePercent‚83.24335756603737 disk.dm-0.in‚ 253.32421875 disk.sdb.out‚490.4638671875 disk.sdb2.in‚9.4375 disk.md0p1.in‚ 67.203125# disk.nvme1n1.out‚24981.03515625# proc.memory.rssMB‚ 3087.03515625 network.recv‚ 1.414827e+06 disk.nvme1n1.in‚ 32.45703125 proc.cpu.threads‚17 disk.sda.in‚ 57.765625 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚29809.45703125 disk.sdb2.out‚490.4638671875 disk.rbd0.out‚ 0.900390625" memory_percent‚92.667555809021) proc.memory.availableMB‚ 1201.34765625 disk.sdb1.out‚0 disk.sda.out‚490.4638671875 disk.sda2.out‚490.4638671875 network.sent‚ 8.21393e+06 disk.dm-0.out‚ 54790.4921875 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda2.in‚ 57.765625 disk.md0p1.out‚ 472.56640625 disk.rbd0.in‚0 cpu‚25.749363902105596$ disk./.usageGB‚2977.185676574707 disk.rbd2.out‚1.0625 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125 disk.md0.out‚ 472.56640625) proc.memory.percent‚18.84176731109619 disk.sda1.in‚0.“É‚(:ˆ  ¨èÔ‚®¶« gpu.0.gpu‚65.0 gpu.0.memory‚15, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚203.75' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚50.9375 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0&¤ ”fÊ‚(:Û  ¨èÔèÒ‘­ disk.md0p1.out‚ 474.71484375 network.sent‚ 8.22126e+06 disk.sda.in‚ 57.765625 disk.sdb2.in‚9.4375 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 proc.cpu.threads‚17$ disk./.usageGB‚2977.310619354248 disk.sdb1.out‚0 disk.sda1.in‚0# disk.nvme0n1.out‚29809.51171875 disk.md0.out‚ 474.71484375 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚1.0625$ memory_percent‚92.66526699066162) proc.memory.percent‚18.84176731109619 network.recv‚ 1.418358e+06# disk.nvme1n1.out‚25273.33984375! disk.sdb2.out‚492.66748046875# proc.memory.rssMB‚ 3087.03515625 cpu‚25.748361095509665) disk./.usagePercent‚83.24685101844595 disk.sdb1.in‚0 disk.sda2.in‚ 57.765625 disk.sda.out‚492.66748046875 disk.sdb.out‚492.66748046875 disk.sda1.out‚0 disk.sdb.in‚9.4375 disk.rbd0.out‚ 0.900390625 disk.rbd2.in‚0) proc.memory.availableMB‚ 1201.72265625! disk.sda2.out‚492.66748046875 disk.dm-0.out‚ 55082.8515625YEæ3’Ë‚(:‡ ¯¨èÔ¾×É© gpu.0.gpu‚49.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚225.248' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.312 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0®µ¦XÌ‚(:Í ¯¨èÔá©¿ª disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚494.2861328125 disk.sda2.out‚494.2861328125 network.sent‚ 8.225467e+06$ disk./.usageGB‚2976.249500274658 disk.sdb2.in‚9.4375 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 cpu‚25.74752694289695" disk.nvme1n1.out‚ 25421.8828125 disk.md0.out‚ 476.265625 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.sdb.in‚9.4375 disk.sda.in‚ 57.765625 disk.sda1.in‚0$ memory_percent‚92.66905784606934) proc.memory.percent‚18.84176731109619 disk.rbd0.out‚ 0.900390625 disk.rbd2.out‚1.0625 disk.sda.out‚494.2861328125 disk.sdb1.in‚0# proc.memory.rssMB‚ 3087.03515625" disk.nvme0n1.out‚ 29810.0703125 disk.sdb2.out‚494.2861328125 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.sda1.out‚0( proc.memory.availableMB‚ 1201.1015625 proc.cpu.threads‚17 network.recv‚ 1.42291e+06( disk./.usagePercent‚83.2171816848678 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 476.265625 disk.dm-0.out‚ 55231.953125Â,2Í- _wandbruntime‚4263  _runtime‚4263UãŸÉÎà trainer/global_step‚3799 % _timestamp‚1.7884826114960601e+09 _runtime‚4263.606408111 _step‚306 ' lr-AdamW/pg1‚0.00043531249697874275 ' lr-AdamW/pg2‚0.00043531249697874275pµÎÏÈ ' lr-AdamW/pg2‚0.00043531249697874275 trainer/global_step‚3799 % _timestamp‚1.7884826114960601e+09 _runtime‚4263.606408111 _step‚306 ' lr-AdamW/pg1‚0.00043531249697874275²â¥1Ê2Ð- _wandbruntime‚4263  _runtime‚4263Ä58ò'ÑìO PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚68804310 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚68804308 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚42820440 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚452433067218944 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚525571284507648 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚521398852254720 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚521398852254720 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚447911445772288 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4158433410758 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚512507207963952 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚528 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚531 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 153036580 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4521621446656 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4521459107840 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚521398835215360 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚62618841 trainer/global_step‚3799 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚521398835215360 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4172432252928 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4171648776192 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚525571284507648 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 187242496 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚516664859892826 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚512507225003312 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚525570483991552 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚68804310 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚84232272 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚19798398 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4157651928874 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚42820443 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚4263.610821781 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚525570483991552 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4172432252928 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚525570483991552 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚68804310 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚84232272 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚19798398 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4157651928874 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚42820443 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚4263.610821781 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚525570483991552 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4172432252928 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚42820440 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚452433067218944 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚525571284507648 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚521398852254720 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚521398852254720 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚447911445772288 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4158433410758 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚512507207963952 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚528 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚531 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792³¦áˆÿ2Ó- _wandbruntime‚4264  _runtime‚4264}s—emÔöM ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚525704301642240 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚517 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚452548181434880 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚84253960 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚448025589575168 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚42831203 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚521531603566592 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4173498605056 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚62634469 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4522616763392 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 153099020 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 153075720 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚514 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 _runtime‚4264.432228445 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚512637875204352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 153075720 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19802752 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚521531586527232 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚62633952 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚521531603566592 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 153099020 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚84277258 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚84253960 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4522770700288 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4159496156292 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚516796572839192 trainer/global_step‚3799}'ÕûM WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚516797371360644 _step‚308 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚517 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚452548181434880 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚84253960 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚448025589575168 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚42831203 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚521531603566592 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4173498605056 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚62634469 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4522616763392 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 153099020 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 153075720 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚514 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 _runtime‚4264.432228445 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚512637875204352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 153075720 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚19802752 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚521531586527232 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚62633952 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚521531603566592 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 153099020 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚84277258 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚84253960 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4522770700288 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4159496156292 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚516796572839192 trainer/global_step‚3799 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚525704301642240 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚43358443 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚519039735055312 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚85320024 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 189339648 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚528036400808960 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚527 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚532262194870272 UADeviceStatsMoniN´÷é£tor.on_train_batch_start/allocated_bytes.all.freed‚532261394354176 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4224993545216 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚69676908 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚85343296 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4225777021952 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚453618635916288 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚532261394354176 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚63405933 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚43358440 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 % _timestamp‚1.7884826586800184e+09 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚528036417848320 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _runtime‚4310.793790661 _step‚311 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚528036417848320 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4579268169728 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚458198068521984 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚528036400808960 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚453618611012608 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 trainer/global_step‚3849 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166lݤA÷'äñO JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚43358443 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚519039735055312 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚85320024 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 189339648 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚528036400808960 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚527 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚532262194870272 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚532261394354176 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4224993545216 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚69676908 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚85343296 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4225777021952 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚453618635916288 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚532261394354176 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚63405933 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚43358440 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 % _timestamp‚1.7884826586800184e+09 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚528036417848320 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _runtime‚4310.793790661 _step‚311 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚528036417848320 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4579268169728 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚458198068521984 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚528036400808960 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚453618611012608 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 trainer/global_step‚3849 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚532262194870272 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 155020206 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 164435968 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚519039718015952 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4211597849066 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚69676910 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4579432605696 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚523251332904378 JDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4226843374080 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4226059884032 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚528169152120832 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4226059884032 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4211879112508 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚69694362 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 _runtime‚4311.617481742 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4226843374080 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚20051907 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4580432848384 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 155059372 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚85365010 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚63421107 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4212660594600 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚69694360 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4580582590976 trainer/global_step‚3849 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚523382247329500 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 _step‚312 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚534 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 155036072 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚85341712 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚63421644 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚458313362310144 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚519170385256352 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚458313187663872 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚43369203 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚69694362 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 155059372 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚20052441 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚85365010 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚63421107 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4212660594600 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚69694360 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4580582590976 trainer/global_step‚3849 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚523382247329500 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 _step‚312 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚534 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 155036072 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚85341712 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚63421644 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚458313362310144 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚519170385256352 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚458313187663872 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚43369203 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚69694362 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 155059372 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚20052441 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚85365010 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4226843374080 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4226059884032 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚528169152120832 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4226059884032 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4211879112508 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 REDeviceStatsMonitor.on_train_batc„u¨ ìh_end/allocation.large_pool.allocated‚69694362 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 _runtime‚4311.617481742 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4226843374080 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚20051907 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4580432848384 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 155059372 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚85365010 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320¸ò£ë 2è- _wandbruntime‚4311  _runtime‚4311Ñy»<\éÖ 2loss/FBt2/assignment_loss‚0.054344810823522494 -loss/FRt4/detection_loss‚2.09846377040304 2loss/SRqqt1/assignment_loss‚0.8209575540066221 0loss/FBt3/assignment_loss‚0.2901846385042962 .loss/FRt3/detection_loss‚3.102225434035063 /loss/FBt3/detection_loss‚2.6272830177437174 &loss/total_loss‚38.417079269457815 epoch‚6 trainer/global_step‚3849 /loss/FRt3/assignment_loss‚3.342916006843249 2loss/SRqqt4/assignment_loss‚1.4424663040074794 1loss/FBt4/assignment_loss‚0.25263889813302537 _runtime‚4311.618562857 _step‚313 0loss/FRt4/assignment_loss‚2.8681318478637867 2loss/SRqqt3/assignment_loss‚1.8595009859847396 /loss/FBt1/detection_loss‚0.6777803611645586 /loss/FBt2/detection_loss‚1.9691251028432615 /loss/FBt4/detection_loss‚1.9158859650293987 % _timestamp‚1.7884826595085526e+09 0loss/FRt1/assignment_loss‚1.3587159578518202 1loss/SRqqt3/detection_loss‚2.3622352031239293 ,loss/FRt1/detection_loss‚1.7352986685451 /loss/FRt2/assignment_loss‚1.638871411072839 1loss/FBt1/assignment_loss‚0.11150437732501345 /loss/FRt2/detection_loss‚2.0227604657411575 1loss/SRqqt1/detection_loss‚1.0970957759227462 2loss/SRqqt2/assignment_loss‚1.1317101032308796 1loss/SRqqt2/detection_loss‚1.1888611468760406 1loss/SRqqt4/detection_loss‚2.4481214623825225´Jp§aêÛ /loss/FRt2/assignment_loss‚1.638871411072839 1loss/FBt1/assignment_loss‚0.11150437732501345 /loss/FRt2/detection_loss‚2.0227604657411575 1loss/SRqqt1/detection_loss‚1.0970957759227462 2loss/SRqqt2/assignment_loss‚1.1317101032308796 1loss/SRqqt2/detection_loss‚1.1888611468760406 1loss/SRqqt4/detection_loss‚2.4481214623825225 2loss/FBt2/assignment_loss‚0.054344810823522494 -loss/FRt4/detection_loss‚2.09846377040304 2loss/SRqqt1/assignment_loss‚0.8209575540066221 0loss/FBt3/assignment_loss‚0.2901846385042962 .loss/FRt3/detection_loss‚3.102225434035063 /loss/FBt3/detection_loss‚2.6272830177437174 &loss/total_loss‚38.417079269457815 epoch‚6 trainer/global_step‚3849 /loss/FRt3/assignment_loss‚3.342916006843249 2loss/SRqqt4/assignment_loss‚1.4424663040074794 1loss/FBt4/assignment_loss‚0.25263889813302537 _runtime‚4311.618562857 _step‚313 0loss/FRt4/assignment_loss‚2.8681318478637867 2loss/SRqqt3/assignment_loss‚1.8595009859847396 /loss/FBt1/detection_loss‚0.6777803611645586 /loss/FBt2/detection_loss‚1.9691251028432615 /loss/FBt4/detection_loss‚1.9158859650293987 % _timestamp‚1.7884826595085526e+09 0loss/FRt1/assignment_loss‚1.3587159578518202 1loss/SRqqt3/detection_loss‚2.3622352031239293 ,loss/FRt1/detection_loss‚1.7352986685451¹D“Žw”ë‚(:‰ ë¨èÔ­ ª gpu.0.gpu‚83.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚231.046' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.7615 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚00(º"jì‚(:ß ë¨èÔïÔëª disk.dm-0.out‚ 55639.4453125 network.recv‚ 1.44052e+06 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.4375 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.rbd2.out‚ 1.2158203125# proc.memory.rssMB‚ 3087.03515625 network.sent‚ 8.328788e+06% disk./.usageGB‚2975.8718795776367 disk.sda.in‚ 57.765625 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚25828.71484375 disk.md0.out‚ 482.6328125 disk.md0p1.in‚ 67.203125 disk.sda.out‚500.90966796875 disk.sdb.out‚500.90966796875# memory_percent‚92.6640510559082' proc.memory.availableMB‚ 1201.921875 disk.sdb1.in‚0 disk.sda1.in‚0 disk.sdb2.in‚9.4375 disk.rbd0.out‚ 1.06591796875 disk.sdb1.out‚0! disk.sdb2.out‚500.90966796875 disk.md0p1.out‚ 482.6328125 proc.cpu.threads‚17 cpu‚25.744056108453524# disk.nvme0n1.out‚29810.73046875! disk.sda2.out‚500.90966796875 disk.md0.in‚ 67.203125) proc.memory.percent‚18.84176731109619) disk./.usagePercent‚83.20662325213253 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0 ;•Kží‚(:“ ú¨èÔàžÃ© gpu.0.gpu‚76.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚220.183' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚55.04574999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 9‡Yî‚(:Î ú¨èÔÛí´ª disk.sda.out‚ 502.5078125 disk.sda2.out‚ 502.5078125 disk.md0p1.out‚ 484.171875 disk.rbd0.in‚0) proc.memory.percent‚18.84176731109619 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375 disk.sda2.in‚ 57.765625 proc.cpu.threads‚17 network.recv‚ 1.444967e+06% disk./.usageGB‚2976.1178855895996 disk.sdb2.in‚9.4375 disk.md0p1.in‚ 67.203125 disk.dm-0.out‚ 55759.796875 cpu‚25.74328115352105# disk.nvme0n1.out‚29810.77734375 disk.nvme1n1.in‚ 32.45703125 disk.sda1.out‚0 disk.md0.out‚ 484.171875 disk.rbd0.out‚ 1.06591796875 disk.dm-0.in‚ 253.32421875 network.sent‚ 8.41455e+06 disk.sdb1.out‚0 disk.sda.in‚ 57.765625 disk.sda1.in‚0 disk.sdb.out‚ 502.5078125$ memory_percent‚92.66412258148193# proc.memory.rssMB‚ 3087.03515625 disk.sdb1.in‚0 disk.sdb2.out‚ 502.5078125 disk.md0.in‚ 67.203125 disk.rbd2.in‚0 disk.rbd2.out‚ 1.2158203125) proc.memory.availableMB‚ 1201.91015625# disk.nvme1n1.out‚25949.01953125) disk./.usagePercent‚83.21350168318853Þ°u“ï‚(:ˆ ‰©èÔÇô«« gpu.0.gpu‚41.0 gpu.0.memory‚7, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚174.562' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚43.6405 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Xt·îgð‚(:Ü ‰©èÔ¢Š¶¬) disk./.usagePercent‚83.21874575491081 disk.sda.out‚504.59228515625 disk.sda1.in‚0 disk.rbd2.in‚0 disk.rbd2.out‚ 1.2158203125# proc.memory.rssMB‚ 3087.03515625) proc.memory.percent‚18.84176731109619 cpu‚25.742481476402357 network.sent‚ 8.421162e+06 network.recv‚ 1.449822e+06% disk./.usageGB‚2976.3054389953613 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.dm-0.out‚ 55903.6953125$ memory_percent‚92.66412258148193) proc.memory.availableMB‚ 1201.91015625" disk.nvme0n1.out‚ 29810.9765625 disk.dm-0.in‚ 253.32421875 proc.cpu.threads‚17! disk.sda2.out‚504.59228515625 disk.md0.out‚ 486.1640625 disk.sda.in‚ 57.765625 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚504.59228515625 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0 disk.md0.in‚ 67.203125 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.out‚ 26092.71875 disk.sdb.in‚9.4375 disk.sdb.out‚504.59228515625 disk.sdb2.in‚9.4375 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 486.1640625 disk.rbd0.out‚ 1.12890625 disk.sda1.out‚0½¢~^2ñ- _wandbruntime‚4359  _runtime‚4359Ï{|ÆòÀ & lr-AdamW/pg1‚0.0004023415146241047 & lr-AdamW/pg2‚0.0004023415146241047 trainer/global_step‚3899 % _timestamp‚1.7884827074287653e+09 _runtime‚ 4359.54202472 _step‚314DIìËóÅ % _timestamp‚1.7884827074287653e+09 _runtime‚ 4359.54202472 _step‚314 & lr-AdamW/pg1‚0.0004023415146241047 & lr-AdamW/pg2‚0.0004023415146241047 trainer/global_step‚3899º!;Õ2ô- _wandbruntime‚4359  _runtime‚4359ªum ò'õìO JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4278338314240 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚20297796 % _timestamp‚1.7884827074296448e+09 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 156980558 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚70549508 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4636901255680 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚525572228067952 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚534673966402560 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚538952304716800 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 156957284 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚459325826060288 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4264762287374 trainer/global_step‚3899 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚538952304716800 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚70549508 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚534673966402560 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4637055205888 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4263980805490 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚538953105232896 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚43896440 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚459325801156608 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚86407776 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚315 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚64194236 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚529837007394686 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚525572245107312 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400VeUÌ÷'öñO VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚43896443 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4279121790976 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚70549510 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚463962881266176 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚64194770 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚86431048 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚534673983441920 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚538953105232896 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚531 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚538952304716800 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 156957284 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚459325826060288 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4264762287374 trainer/global_step‚3899 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚538952304716800 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚70549508 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚534673966402560 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4637055205888 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4263980805490 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚538953105232896 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚43896440 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚459325801156608 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚86407776 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚315 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚64194236 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚529837007394686 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚525572245107312 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4278338314240 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚20297796 % _timestamp‚1.7884827074296448e+09 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 156980558 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚70549508 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4636901255680 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚525572228067952 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚534673966402560 JDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚539086922896896 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚86452762 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4265043550816 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚316 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚539086922896896 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚86429464 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚70566960 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 _runtime‚4360.381898647 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚70566962 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚529967921819808 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 156996424 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4265825032908 S?DeviceStats²ß TMonitor.on_train_batch_end/allocated_bytes.all.freed‚539086122367488 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚464078009864192 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚459439969863168 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚43907200 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 157019724 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 156996424 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚541 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 157019724 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚64209926 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚464078186607616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4280188143104 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚534806717714432 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4279404653056 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚529968720341260 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚70566960 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 trainer/global_step‚3899 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚534806734753792 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚525702895308352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚538 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚20302726J5\Ÿ'ùûM NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚70566960 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 _runtime‚4360.381898647 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚70566962 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚529967921819808 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 156996424 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4265825032908 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚539086122367488 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚464078009864192 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚459439969863168 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚43907200 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 157019724 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 156996424 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚541 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 157019724 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚64209926 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚464078186607616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4280188143104 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚534806717714432 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4279404653056 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚529968720341260 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚70566960 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 trainer/global_step‚3899 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚534806734753792 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚525702895308352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚538 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚20302726 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4279404653056 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚43907203 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚539086922896896 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚86452762 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4265043550816 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚316 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚539086922896896 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚86429464 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616¼§DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚71422108 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚545643215079424 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚541311531996160 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚469727904021504 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚541311549035520 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4694887817216 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚465033016204288 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚541311549035520 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4317145243798 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚44434440 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚87495528 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚545643215079424 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚20548728 _step‚319 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚532104738119952 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 trainer/global_step‚3949 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.alxÙÑ°™ located‚ 4332466560000 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚545644015595520 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4332466560000 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚64983168 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚87518800 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚44434443 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884R”g÷'ˆñO A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚44434440 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚87495528 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚545643215079424 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚20548728 _step‚319 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚532104738119952 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 trainer/global_step‚3949 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4332466560000 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚545644015595520 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4332466560000 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚64983168 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚87518800 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚44434443 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚541311531996160 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚87495528 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚71422108 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚545643215079424 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚541311531996160 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚469727904021504 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚541311549035520 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4694887817216 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚465033016204288 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚541311549035520 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4317145243798 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1¿3ó°2‰- _wandbruntime‚4408  _runtime‚4408sÙÍü&ŠöM TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚541444283308032 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚545777032730112 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 158956776 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚64998889 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚532235405360352 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4318207989124 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚20554203 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚469843023409664 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚71439560 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚469843206444544 _step‚320 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚536554394831568 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚44445200 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚536553596310116 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚532235388320992 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚545777833259520 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚541444300347392 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 158980076 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚87517216 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚87517216 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚64999406 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚71439560 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚44445203 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4696046437376 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚517 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚71439562 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚514 % _timestamp‚1.7884827566226966e+09 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 158980076 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 158956776 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 B&‹ûM H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 158956776 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚64998889 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚532235405360352 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4318207989124 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚20554203 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚469843023409664 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚71439560 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚469843206444544 _step‚320 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚536554394831568 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚44445200 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚536553596310116 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚532235388320992 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚545777833259520 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚541444300347392 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 158980076 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚87517216 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚87517216 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚64999406 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚71439560 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚44445203 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4696046437376 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚517 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚71439562 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚514 % _timestamp‚1.7884827566226966e+09 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 158980076 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 158956776 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚545777032730112 TFDevic¶é*aâeStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785À¯™Xo2Œ- _wandbruntime‚4408  _runtime‚4408 Y%/\Ö 1loss/SRqqt3/detection_loss‚2.4066583625340865 trainer/global_step‚3949 /loss/FRt2/detection_loss‚1.9702828112288866 /loss/FBt4/assignment_loss‚0.646126599041357 1loss/SRqqt1/detection_loss‚0.9047633837774504 1loss/SRqqt2/detection_loss‚1.2594877312106914 0loss/FRt1/assignment_loss‚1.4709445110867532 0loss/FRt4/assignment_loss‚2.9903779373220774 2loss/SRqqt2/assignment_loss‚1.0430245388813906 _step‚321 2loss/SRqqt1/assignment_loss‚0.9108768514484811 1loss/FBt1/assignment_loss‚0.09654436677695344 2loss/FBt2/assignment_loss‚0.006377896896283224 %loss/total_loss‚39.15180968905064 1loss/FBt3/assignment_loss‚0.19891431406722404 /loss/FRt4/detection_loss‚2.1357212264866456 % _timestamp‚1.7884827566259818e+09 .loss/FBt3/detection_loss‚2.797035723924637 .loss/FBt4/detection_loss‚2.391078927119573 /loss/FRt2/assignment_loss‚2.064091429261878 /loss/FRt3/assignment_loss‚3.319891835962023 2loss/SRqqt3/assignment_loss‚1.6962262767098717 /loss/FRt1/detection_loss‚1.7953078679824144 /loss/FBt1/detection_loss‚0.6011817180551589 /loss/FBt2/detection_loss‚1.5268872965659415 2loss/SRqqt4/assignment_loss‚1.5209930566832042 .loss/FRt3/detection_loss‚3.229141808286005 0loss/SRqqt4/detection_loss‚2.169873217741648 epoch‚6 _runtime‚4408.736172644åú¿0aŽÛ 1loss/FBt3/assignment_loss‚0.19891431406722404 /loss/FRt4/detection_loss‚2.1357212264866456 % _timestamp‚1.7884827566259818e+09 .loss/FBt3/detection_loss‚2.797035723924637 .loss/FBt4/detection_loss‚2.391078927119573 /loss/FRt2/assignment_loss‚2.064091429261878 /loss/FRt3/assignment_loss‚3.319891835962023 2loss/SRqqt3/assignment_loss‚1.6962262767098717 /loss/FRt1/detection_loss‚1.7953078679824144 /loss/FBt1/detection_loss‚0.6011817180551589 /loss/FBt2/detection_loss‚1.5268872965659415 2loss/SRqqt4/assignment_loss‚1.5209930566832042 .loss/FRt3/detection_loss‚3.229141808286005 0loss/SRqqt4/detection_loss‚2.169873217741648 epoch‚6 _runtime‚4408.736172644 1loss/SRqqt3/detection_loss‚2.4066583625340865 trainer/global_step‚3949 /loss/FRt2/detection_loss‚1.9702828112288866 /loss/FBt4/assignment_loss‚0.646126599041357 1loss/SRqqt1/detection_loss‚0.9047633837774504 1loss/SRqqt2/detection_loss‚1.2594877312106914 0loss/FRt1/assignment_loss‚1.4709445110867532 0loss/FRt4/assignment_loss‚2.9903779373220774 2loss/SRqqt2/assignment_loss‚1.0430245388813906 _step‚321 2loss/SRqqt1/assignment_loss‚0.9108768514484811 1loss/FBt1/assignment_loss‚0.09654436677695344 2loss/FBt2/assignment_loss‚0.006377896896283224 %loss/total_loss‚39.15180968905064Á^~87•‚(:Š Å©èÔ¡Öð« gpu.0.gpu‚41.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚137.083' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚34.27075 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0£hFm‚(:â Å©èÔ”œ¬) proc.memory.percent‚18.84176731109619) disk./.usagePercent‚83.21470172083542 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125 disk.dm-0.in‚ 253.32421875 disk.sdb1.in‚0$ memory_percent‚92.66278743743896 network.recv‚ 1.467921e+06$ disk./.usageGB‚2976.160804748535 disk.md0p1.in‚ 67.203125 disk.sda1.in‚0 disk.sda1.out‚0 cpu‚25.739099376279412 network.sent‚ 8.538222e+06 disk.sdb.out‚511.45654296875 disk.nvme0n1.in‚ 220.8671875 disk.rbd2.out‚ 1.341796875 disk.sda.in‚ 57.765625 disk.dm-0.out‚ 56353.328125 proc.cpu.threads‚17 disk.sdb2.in‚9.4375 disk.md0.out‚ 492.74609375 disk.md0p1.out‚ 492.74609375) proc.memory.availableMB‚ 1202.12890625# proc.memory.rssMB‚ 3087.03515625 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚511.45654296875! disk.sda2.out‚511.45654296875 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.sda.out‚511.45654296875# disk.nvme0n1.out‚29811.40234375# disk.nvme1n1.out‚26541.92578125 disk.sdb.in‚9.4375 disk.rbd0.out‚ 1.19189453125 disk.rbd2.in‚0FH¼ñŸ‘‚(:” Ô©èÔù¥Ø© gpu.0.gpu‚75.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚227.422' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚56.855500000000006 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0½Åq¸`’‚(:Õ Ô©èÔœ˜×ª disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375) disk./.usagePercent‚83.21884409592144 disk.sda1.out‚0 disk.rbd0.out‚ 1.19189453125# proc.memory.rssMB‚ 3087.03515625 disk.sda.out‚ 512.810546875# disk.nvme0n1.out‚29811.48046875 disk.nvme1n1.out‚ 26614.625 disk.dm-0.out‚56426.10546875& proc.memory.availableMB‚ 1201.59375% disk./.usageGB‚2976.3089561462402 disk.rbd2.out‚ 1.341796875 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.md0p1.out‚ 494.05078125) proc.memory.percent‚18.84176731109619 cpu‚25.738201978578264 network.sent‚ 8.611123e+06 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.4375 disk.md0.out‚ 494.05078125 network.recv‚ 1.472716e+06 disk.rbd2.in‚0 disk.md0.in‚ 67.203125 disk.dm-0.in‚ 253.32421875$ memory_percent‚92.66605377197266 disk.sdb.out‚ 512.810546875 disk.sdb2.out‚ 512.810546875 disk.sda2.in‚ 57.765625 disk.sda2.out‚ 512.810546875 disk.md0p1.in‚ 67.203125 disk.rbd0.in‚0 proc.cpu.threads‚17 disk.sda.in‚ 57.765625FñáK”“‚(:‰ ã©èÔ¾Šþ© gpu.0.gpu‚15.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚230.437' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.60925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ª¤H h”‚(:Ý ã©èÔÌìþª disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125 disk.sdb.out‚514.87548828125) disk./.usagePercent‚83.22591344932994 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0" disk.nvme0n1.out‚ 29880.1640625 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚514.87548828125 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375 network.recv‚ 1.477091e+06% disk./.usageGB‚2976.5617904663086 disk.md0p1.out‚ 496.0390625 disk.sda.out‚514.87548828125 disk.sda1.out‚0 disk.rbd0.in‚0 disk.rbd0.out‚ 1.19189453125$ memory_percent‚92.66486167907715# proc.memory.rssMB‚ 3087.03515625! disk.sda2.out‚514.87548828125 disk.md0.out‚ 496.0390625 disk.sda1.in‚0 proc.cpu.threads‚17 disk.rbd2.in‚0 disk.sda.in‚ 57.765625 disk.nvme1n1.out‚ 26614.78125( proc.memory.availableMB‚ 1201.7890625 disk.dm-0.out‚ 56494.9453125 network.sent‚ 8.617536e+06 disk.rbd2.out‚ 1.341796875 disk.sdb2.in‚9.4375 disk.md0p1.in‚ 67.203125 disk.sdb1.in‚0) proc.memory.percent‚18.84176731109619 cpu‚25.737400076587683n‘è&••‚(:Š ò©è԰Ω gpu.0.gpu‚85.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚216.789' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.19725 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ïCõe–‚(:Ú ò©èÔ¡´»ª disk.dm-0.out‚56717.42578125 disk.sda.in‚ 57.765625# proc.memory.rssMB‚ 3087.03515625 proc.cpu.threads‚17 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda.out‚516.3232421875 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125 disk.md0.out‚ 497.421875 disk.rbd2.out‚ 1.341796875 disk.sdb2.in‚9.4375 disk.sdb2.out‚516.3232421875$ memory_percent‚92.66486167907715 network.recv‚ 1.481272e+06% disk./.usageGB‚2976.6856956481934 disk.sda2.out‚516.3232421875 disk.sdb1.in‚0 disk.sda1.out‚0 disk.md0p1.out‚ 497.421875 disk.sda1.in‚0 disk.sdb.in‚9.4375 disk.sdb.out‚516.3232421875) proc.memory.percent‚18.84176731109619 network.sent‚ 8.62286e+06 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚29958.58984375" disk.nvme1n1.out‚ 26758.8359375) disk./.usagePercent‚83.22937789007378 disk.rbd0.in‚0 disk.rbd0.out‚ 1.19189453125 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.in‚ 67.203125( proc.memory.availableMB‚ 1201.7890625 cpu‚25.736502203289913¸J2—- _wandbruntime‚4456  _runtime‚4456š,CéǘÁ trainer/global_step‚3999 % _timestamp‚1.7884828040794253e+09 _runtime‚4456.189773575 _step‚322 & lr-AdamW/pg1‚0.0003700242215157455 & lr-AdamW/pg2‚0.0003700242215157455 ¸`¨Ì™Æ & lr-AdamW/pg1‚0.0003700242215157455 & lr-AdamW/pg2‚0.0003700242215157455 trainer/global_step‚3999 % _timestamp‚1.7884828040794253e+09 _runtime‚4456.189773575 _step‚322Â:¾Ál2š- _wandbruntime‚4456  _runtime‚4456E|qõò'›ìO M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚547949114629120 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 trainer/global_step‚3999 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚543008356375302 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚20799189 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚470740181444608 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4385027852288 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚475492897729024 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4385811329024 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚552334925958144 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 160901262 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4752716284416 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚65772153 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚88606552 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚88583280 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚470740206348288 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚543007557854058 _runtime‚4456.193727873 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚88606552 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _step‚323 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚72294710 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚552334125442048 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4385027852288 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚538637248171952 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚552334125442048 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚72294710 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚44972443 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 % _timestamp‚1.7884828040832617e+09yƒÈÄ÷'œñO A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚543007557854058 _runtime‚4456.193727873 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚88606552 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _step‚323 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚72294710 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚552334125442048 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4385027852288 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚538637248171952 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚552334125442048 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚72294710 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚44972443 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 % _timestamp‚1.7884828040832617e+09 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚547949114629120 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 trainer/global_step‚3999 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚543008356375302 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚20799189 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚470740181444608 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4385027852288 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚475492897729024 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4385811329024 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚552334925958144 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 160901262 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4752716284416 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚65772153 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚88606552 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚88583280 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚470740206348288ÃtËd2- _wandbruntime‚4457  _runtime‚4457d½hŽš žöM ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚538767915412352 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4386877681152 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚65787433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 170451968 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚88628266 D>DeviceStatsMonitor.on_train_batch_end/sb °begment.large_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚543139270800424 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚552468743622144 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚548081848901632 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚548081848901632 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚88604968 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚20804731 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4386094191104 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚552468743622144 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 160940428 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚538767898372992 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚548081865940992 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 160917128 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚501 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _runtime‚4457.037915195 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4372153909524 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _step‚324 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚475608383969792 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚44983203 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚72312162 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚72312162 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚470854325247488 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0v§gò'ŸûM UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚88604968 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚20804233 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚475608213517824 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4386877681152 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚65787433 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 170451968 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚88628266 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚543139270800424 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚552468743622144 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚548081848901632 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚548081848901632 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚88604968 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚20804731 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4386094191104 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚552468743622144 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 160940428 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚538767898372992 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚548081865940992 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 160917128 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚501 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _runtime‚4457.037915195 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4372153909524 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _step‚324 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚475608383969792 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚44983203 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚72312162 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚72312162 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚470854325247488 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚538767915412352 EDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚73167308 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚559025836320768 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚327 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚559025035804672 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 162838340 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 trainer/global_step‚4049 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚21050436 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚66561406 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚45510443 eQDeviceStatsMonitor.on_train_batch_star/ßÚ¢ t/inactive_split_bytes.large_pool.allocated‚476447396492288 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚89671032 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚554586680222720 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚73167308 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 162861614 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _runtime‚4504.101734367 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚66560876 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚549593232344366 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚21050963 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4438372621312 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚89671032 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚481258167281664 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4439156098048 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚559025035804672 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352®õö*÷'®ñO eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚476447396492288 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚89671032 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚554586680222720 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚73167308 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 162861614 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 _runtime‚4504.101734367 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚66560876 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚549593232344366 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚21050963 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4438372621312 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚89671032 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚481258167281664 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4439156098048 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚559025035804672 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4424255602298 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚554586663183360 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚476447371588608 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚545169758223952 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 % _timestamp‚1.7884828519912848e+09 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚73167308 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚559025836320768 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚327 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚559025035804672 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 162838340 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 trainer/global_step‚4049 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚21050436 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚66561406 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚45510443LJ$Å2¯- _wandbruntime‚4505  _runtime‚4505É„Rü&°öM [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 162900780 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚481373285430272 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚73184762 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚531 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4811770038784 % _timestamp‚1.7884828530645797e+09 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚21055932 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚73184760 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4439438960128 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚89692720 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚554719431534592 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚554719414495232 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4440222450176 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚481373468465152 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚89716018 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚545300408424992 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 trainer/global_step‚4049 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚476561540295168 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4424536865740 _step‚328 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚66576601 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚66577135 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚559159653984768 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚476561515391488 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚545300425464352 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚73184762 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 162900780 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚481373285430272 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚73184762 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚531 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4811770038784 % _timestamp‚1.7884828530645797e+09 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚21055932 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚73184760 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4439438960128 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚89692720 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚554719431534592 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚554719414495232 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4440222450176 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚481373468465152 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚89716018 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚545300408424992 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 trainer/global_step‚4049 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚476561540295168 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4424536865740 _step‚328 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚66576601 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚66577135 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚559159653984768 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚476561515391488 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚545300425464352 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚73184762 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 FDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚565716746683392 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4492500867072 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚482154586636288 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚74039910 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚529 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚482154561732608 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4868503186944 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚556178906834674 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚565715946167296 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4868659234304 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚21301700 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚487023245870592 _runtime‚4554.695662384 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚74039908 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚74039908 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚67350669 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 trainer/global_step‚4099 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚551702268275952 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚561224245816320 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚551702285315312 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚90758784 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚565715946167296 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚526 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚46048440 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚331 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚561224228776960 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚74039908 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚74039908 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚67350669 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 trainer/global_step‚4099 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚551702268275952 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚561224245816320 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚551702285315312 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚90758784 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚565715946167296 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚526 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚46048440 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚331 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚561224228776960 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚565716746683392 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4492500867072 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚482154586636288 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚74039910 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚529 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚482154561732608 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4868503186944 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚556178906834674 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚565715946167296 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4868659234304 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚21301700 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚487023245870592 _runtime‚4554.695662384Ë&02Á- _wandbruntime‚4555  _runtime‚4555iÃA7”ÂöM PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚21306859 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚565850564347392 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚74057362 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚4555.613070803 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚90780472 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4492783729152 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚90803770 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚67366059 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚46059200 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚482268730439168 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4478482786140 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚556311418302492 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚487138368401920 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚74057362 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚46059203 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚561356980088832 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚90780472 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚67366590 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚561356997128192 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 164861132 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚487138547242496 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808„ѪQ'ÃûM VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚74057362 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚46059203 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚561356980088832 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚90780472 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚67366590 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚561356997128192 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 164861132 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚487138547242496 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚21306859 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚565850564347392 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚74057362 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚4555.613070803 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚90780472 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4492783729152 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚90803770 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚67366059 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚46059200 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚482268730439168 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4478482786140 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚556311418302492 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚487138368401920̈ï2Ä- _wandbruntime‚4555  _runtime‚4555Žq•hXÅÒ 0loss/FRt4/assignment_loss‚3.1026515681532363 .loss/FRt4/detection_loss‚2.261814409423372 0loss/SRqqt2/detection_loss‚1.103537132154758 .loss/FBt3/detection_loss‚2.103311639279127 1loss/FBt1/assignment_loss‚0.19814789057851667 0loss/SRqqt3/detection_loss‚2.362510274438297 1loss/SRqqt4/detection_loss‚2.3888954942876643 /loss/FRt3/assignment_loss‚2.621446193480978 0loss/FBt3/assignment_loss‚0.4524074358347008 0loss/FBt4/assignment_loss‚0.5917118198744118 .loss/FBt4/detection_loss‚2.187447268387367 epoch‚6 _step‚333 /loss/FBt1/detection_loss‚0.6588490752685339 0loss/FRt1/assignment_loss‚1.5610927384475182 1loss/SRqqt1/assignment_loss‚0.952684882918321 1loss/FBt2/assignment_loss‚0.06173748127128998 /loss/FRt2/detection_loss‚1.9064461436954516 % _timestamp‚1.7884829035045803e+09 /loss/FRt2/assignment_loss‚1.986361973494002 2loss/SRqqt2/assignment_loss‚1.2775908267787217 2loss/SRqqt3/assignment_loss‚1.7393469613995038 2loss/SRqqt4/assignment_loss‚1.7898487826301293 1loss/SRqqt1/detection_loss‚0.9364712090403945 .loss/FBt2/detection_loss‚1.614288286051967 &loss/total_loss‚38.748896207551304 trainer/global_step‚4099 /loss/FRt1/detection_loss‚1.8755630448717495 .loss/FRt3/detection_loss‚3.014733675791293 _runtime‚4555.614611051ùœhY]Æ× 1loss/FBt1/assignment_loss‚0.19814789057851667 0loss/SRqqt3/detection_loss‚2.362510274438297 1loss/SRqqt4/detection_loss‚2.3888954942876643 /loss/FRt3/assignment_loss‚2.621446193480978 0loss/FBt3/assignment_loss‚0.4524074358347008 0loss/FBt4/assignment_loss‚0.5917118198744118 .loss/FBt4/detection_loss‚2.187447268387367 epoch‚6 _step‚333 /loss/FBt1/detection_loss‚0.6588490752685339 0loss/FRt1/assignment_loss‚1.5610927384475182 1loss/SRqqt1/assignment_loss‚0.952684882918321 1loss/FBt2/assignment_loss‚0.06173748127128998 /loss/FRt2/detection_loss‚1.9064461436954516 % _timestamp‚1.7884829035045803e+09 /loss/FRt2/assignment_loss‚1.986361973494002 2loss/SRqqt2/assignment_loss‚1.2775908267787217 2loss/SRqqt3/assignment_loss‚1.7393469613995038 2loss/SRqqt4/assignment_loss‚1.7898487826301293 1loss/SRqqt1/detection_loss‚0.9364712090403945 .loss/FBt2/detection_loss‚1.614288286051967 &loss/total_loss‚38.748896207551304 trainer/global_step‚4099 /loss/FRt1/detection_loss‚1.8755630448717495 .loss/FRt3/detection_loss‚3.014733675791293 _runtime‚4555.614611051 0loss/FRt4/assignment_loss‚3.1026515681532363 .loss/FRt4/detection_loss‚2.261814409423372 0loss/SRqqt2/detection_loss‚1.103537132154758 .loss/FBt3/detection_loss‚2.103311639279127Í{â5I“Ç‚(:ˆ ÛªèÔÆßØ© gpu.0.gpu‚73.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚130.564' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚32.641 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0N· mÈ‚(:â ÛªèÔ™«ã­ network.recv‚ 1.51289e+06 disk.sda2.in‚ 57.765625 disk.md0p1.out‚ 508.83203125 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0) proc.memory.percent‚18.84176731109619 disk.sdb.out‚528.23388671875! disk.sda2.out‚528.23388671875 disk.rbd2.out‚ 1.341796875 cpu‚25.73095192047434 proc.cpu.threads‚17 disk.sda.out‚528.23388671875 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.dm-0.out‚57842.93359375) proc.memory.availableMB‚ 1201.41015625# proc.memory.rssMB‚ 3087.03515625! disk.sdb2.out‚528.23388671875) disk./.usagePercent‚83.24071803784896 disk.sda1.in‚0 disk.sda1.out‚0 disk.md0.out‚ 508.83203125 disk.rbd0.out‚ 1.19189453125 network.sent‚ 8.826181e+06 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda.in‚ 57.765625 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125" disk.nvme1n1.out‚ 27336.1171875 disk.md0p1.in‚ 67.203125% disk./.usageGB‚2977.0912742614746# disk.nvme0n1.out‚30506.81640625 disk.sdb2.in‚9.4375$ memory_percent‚92.66717433929443Ìûe‘É‚(:† êªèÔൗ« gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚191.668' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚47.917 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0’eÊ‚(:Ú êªèÔÌÃ÷¬ disk.sdb1.in‚0 disk.sda.out‚530.2919921875 disk.nvme1n1.in‚ 32.45703125) proc.memory.availableMB‚ 1201.56640625 network.recv‚ 1.51664e+06 disk.md0.in‚ 67.203125 disk.sdb.in‚9.4375$ memory_percent‚92.66622066497803) disk./.usagePercent‚83.24333932708639 disk.sda2.in‚ 57.765625 disk.md0p1.out‚ 510.8203125 disk.sdb1.out‚0 disk.sdb2.in‚9.4375) proc.memory.percent‚18.84176731109619 proc.cpu.threads‚17 disk.sda2.out‚530.2919921875 disk.rbd2.in‚0 disk.rbd2.out‚ 1.341796875 disk.nvme0n1.in‚ 220.8671875 disk.sdb2.out‚530.2919921875 cpu‚25.729939635879138 disk.sda.in‚ 57.765625 disk.sda1.in‚0# disk.nvme0n1.out‚30557.69921875 disk.nvme1n1.out‚ 27552.1875% disk./.usageGB‚2977.1850242614746 disk.dm-0.in‚ 253.32421875 disk.sdb.out‚530.2919921875 disk.md0.out‚ 510.8203125 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 1.19189453125 disk.dm-0.out‚58109.88671875 disk.sda1.out‚0# proc.memory.rssMB‚ 3087.03515625 network.sent‚ 8.911633e+06 disk.rbd0.in‚0²FéÙ•Ë‚(:Š ùªèÔ¡ÒÔ« gpu.0.gpu‚46.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚210.057' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.51425 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0­5½kÌ‚(:à ùªèÔÕŒ­% disk./.usageGB‚2977.3100814819336" disk.nvme1n1.out‚ 27696.3984375 disk.md0p1.out‚ 512.48828125) proc.memory.percent‚18.84176731109619 disk.sdb1.in‚0 disk.sda1.in‚0 disk.sda1.out‚0 disk.dm-0.out‚58381.58203125) disk./.usagePercent‚83.24683597931093 disk.sdb2.in‚9.4375 disk.md0.in‚ 67.203125 disk.md0.out‚ 512.48828125 disk.dm-0.in‚ 253.32421875# proc.memory.rssMB‚ 3087.03515625 proc.cpu.threads‚17 network.sent‚ 8.919917e+06 disk.sda.in‚ 57.765625 disk.sda.out‚532.02587890625 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0$ memory_percent‚92.66529083251953 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.out‚ 1.19189453125 disk.rbd2.out‚ 1.341796875 disk.sdb1.out‚0 disk.sdb.in‚9.4375 disk.sdb.out‚532.02587890625! disk.sdb2.out‚532.02587890625 network.recv‚ 1.521372e+06# disk.nvme0n1.out‚30685.18359375! disk.sda2.out‚532.02587890625& proc.memory.availableMB‚ 1201.71875 cpu‚25.72919215345432 disk.rbd2.in‚0 disk.md0p1.in‚ 67.203125·å’Í‚(:‡ ˆ«èÔù±¤« gpu.0.gpu‚43.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚193.504' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚48.376 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 ç:l΂(:á ˆ«èÔ–Ñé¬ network.sent‚ 8.925107e+06% disk./.usageGB‚2977.3100242614746 disk.sdb2.in‚9.4375! disk.sdb2.out‚533.92919921875 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125# proc.memory.rssMB‚ 3087.03515625 cpu‚25.72856231172615) disk./.usagePercent‚83.24683437940294 disk.md0.out‚ 514.31640625# disk.nvme1n1.out‚27820.60546875 disk.sdb.in‚9.4375$ memory_percent‚92.66607761383057) proc.memory.availableMB‚ 1201.58984375! disk.sda2.out‚533.92919921875 disk.md0p1.in‚ 67.203125 disk.dm-0.out‚58582.13671875 disk.sdb1.out‚0 disk.sdb.out‚533.92919921875) proc.memory.percent‚18.84176731109619 disk.rbd2.in‚0 disk.sda1.in‚0 disk.rbd2.out‚ 1.341796875 disk.sda.out‚533.92919921875 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 514.31640625 disk.sda.in‚ 57.765625 disk.nvme0n1.in‚ 220.8671875 disk.rbd0.out‚ 1.19189453125 disk.dm-0.in‚ 253.32421875 disk.sda1.out‚0 disk.nvme0n1.out‚ 30761.53125 network.recv‚ 1.525067e+06 disk.rbd0.in‚0 disk.sdb1.in‚0 proc.cpu.threads‚17]d¸2Ï- _wandbruntime‚4610  _runtime‚4610lnñÉÐà ' lr-AdamW/pg1‚0.00032300931298110736 ' lr-AdamW/pg2‚0.00032300931298110736 trainer/global_step‚4149 % _timestamp‚1.7884829588554704e+09 _runtime‚4610.965838953 _step‚334FVʃÎÑÈ trainer/global_step‚4149 % _timestamp‚1.7884829588554704e+09 _runtime‚4610.965838953 _step‚334 ' lr-AdamW/pg1‚0.00032300931298110736 ' lr-AdamW/pg2‚0.00032300931298110736΢LKô2Ò- _wandbruntime‚4610  _runtime‚4610ÞèCÓìO H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚46586440 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚572407657046016 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚487861776780288 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4529802997030 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚567861794370560 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 166782318 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚74912508 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 _runtime‚4610.967689031 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚492788182725120 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚91869808 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚562765379846226 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4530584478914 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚74912510 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚487861751876608 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚572406856529920 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4545845636096 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4926582701568 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚572406856529920 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 trainer/global_step‚4149 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚567861794370560 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚74912508 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚572407657046016 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚567861811409920 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚562764581324982 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚492788359481856 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚558234795367312 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884829588570728e+09 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309ˆãÆ÷'ÔñO GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4529802997030 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚567861794370560 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 166782318 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚74912508 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 _runtime‚4610.967689031 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚492788182725120 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚91869808 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚562765379846226 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4530584478914 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚74912510 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚487861751876608 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚572406856529920 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4545845636096 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4926582701568 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚572406856529920 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 trainer/global_step‚4149 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚567861794370560 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚74912508 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚572407657046016 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚567861811409920 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚562764581324982 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚492788359481856 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚558234795367312 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 % _timestamp‚1.7884829588570728e+09 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚46586440 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚572407657046016 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚487861776780288ÏùšáÊ2Õ- _wandbruntime‚4612  _runtime‚4612À& =ü&ÖöM N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚91868224 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚68157766 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚46597200 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚91868224 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚558365428528992 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4546128498176 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚487975895679488 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚572540674180608 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 166798184 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4546911988224 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 166821484 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚567994545682432 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚74929960 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚558365445568352 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _step‚336 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚74929962 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚91891522 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚562897092792800 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚74929960 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚528 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚562896294271348 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚74929962 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 166798184 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4927744749056 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 trainer/global_step‚4149 % _timestamp‚1.7884829599049876e+09 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚91891522 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚572541474710016 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚572541474710016 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4546128498176 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 _runtime‚4612.019197341 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚567994562721792 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚68158297 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚21560566 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 166821484 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4927590812160 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚46597203 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚531 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚492903665332224 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚567994562721792 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚487975920583168 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 _runtime‚4612.019197341 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚567994562721792 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚68158297 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚21560566 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 166821484 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4927590812160 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚46597203 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚531 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚492903665332224 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚567994562721792 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚487975920583168 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚91868224 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚68157766 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚46597200 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚91868224 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚558365428528992 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4546128498176 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚487975895679488 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚572540674180608 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 166798184 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pooxr;pøl.allocated‚ 4546911988224 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 166821484 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚567994545682432 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚74929960 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚558365445568352Ð{n­´2Ø- _wandbruntime‚4612  _runtime‚4612 ¥xXWÙÑ 0loss/FRt4/assignment_loss‚3.0326811486912755 2loss/SRqqt3/assignment_loss‚1.6511015158315951 _runtime‚4612.020657618 0loss/FRt1/assignment_loss‚1.7647974735498428 0loss/FBt3/assignment_loss‚0.2034616042343216 -loss/FRt3/detection_loss‚2.94582839090316 /loss/FBt1/detection_loss‚0.5651241462879084 %loss/total_loss‚39.83518420979509 /loss/FRt2/assignment_loss‚2.339841884902761 2loss/SRqqt1/assignment_loss‚0.9791178813745344 1loss/SRqqt2/detection_loss‚1.3788770219643218 trainer/global_step‚4149 .loss/FRt3/assignment_loss‚3.43164885434948 1loss/FBt2/assignment_loss‚0.15904019830571497 /loss/FRt2/detection_loss‚2.3401867067795012 1loss/SRqqt1/detection_loss‚0.8731869080456326 1loss/SRqqt4/detection_loss‚2.1154238406349632 _step‚337 2loss/SRqqt2/assignment_loss‚1.3232621985682569 .loss/FBt2/detection_loss‚1.958805103741941 .loss/FBt4/detection_loss‚2.275158221307008 2loss/SRqqt4/assignment_loss‚1.3911700574407244 0loss/FBt1/assignment_loss‚0.1391736971731943 /loss/FRt4/detection_loss‚2.0331666229206338 epoch‚6 .loss/FBt3/detection_loss‚2.404202001435416 $ _timestamp‚1.788482959910386e+09 0loss/FBt4/assignment_loss‚0.3076411214531459 /loss/FRt1/detection_loss‚1.6643654563184827 1loss/SRqqt3/detection_loss‚2.5579221535812726lìœ,\ÚÖ /loss/FRt2/assignment_loss‚2.339841884902761 2loss/SRqqt1/assignment_loss‚0.9791178813745344 1loss/SRqqt2/detection_loss‚1.3788770219643218 trainer/global_step‚4149 .loss/FRt3/assignment_loss‚3.43164885434948 1loss/FBt2/assignment_loss‚0.15904019830571497 /loss/FRt2/detection_loss‚2.3401867067795012 1loss/SRqqt1/detection_loss‚0.8731869080456326 1loss/SRqqt4/detection_loss‚2.1154238406349632 _step‚337 2loss/SRqqt2/assignment_loss‚1.3232621985682569 .loss/FBt2/detection_loss‚1.958805103741941 .loss/FBt4/detection_loss‚2.275158221307008 2loss/SRqqt4/assignment_loss‚1.3911700574407244 0loss/FBt1/assignment_loss‚0.1391736971731943 /loss/FRt4/detection_loss‚2.0331666229206338 epoch‚6 .loss/FBt3/detection_loss‚2.404202001435416 $ _timestamp‚1.788482959910386e+09 0loss/FBt4/assignment_loss‚0.3076411214531459 /loss/FRt1/detection_loss‚1.6643654563184827 1loss/SRqqt3/detection_loss‚2.5579221535812726 0loss/FRt4/assignment_loss‚3.0326811486912755 2loss/SRqqt3/assignment_loss‚1.6511015158315951 _runtime‚4612.020657618 0loss/FRt1/assignment_loss‚1.7647974735498428 0loss/FBt3/assignment_loss‚0.2034616042343216 -loss/FRt3/detection_loss‚2.94582839090316 /loss/FBt1/detection_loss‚0.5651241462879084 %loss/total_loss‚39.83518420979509ÑfË곕Û‚(:Š —«èÔ½¥Ý« gpu.0.gpu‚77.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚06E ábÜ‚(:× —«èÔï±²¬ disk.sdb2.in‚9.4375! disk.sda2.out‚535.96142578125 network.recv‚ 1.529843e+06$ disk./.usageGB‚2977.310104370117 disk.sdb1.in‚0 disk.sda.out‚535.96142578125 disk.sda1.in‚0 disk.sdb.in‚9.4375# disk.nvme0n1.out‚30914.14453125 disk.md0p1.in‚ 67.203125 disk.rbd0.in‚0 disk.rbd0.out‚ 1.25439453125 disk.sdb.out‚535.96142578125# memory_percent‚92.6666259765625 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.in‚ 253.32421875) proc.memory.percent‚18.84176731109619 disk.sda1.out‚0 disk.md0.out‚ 516.28515625 disk.md0p1.out‚ 516.28515625 disk.dm-0.out‚ 58827.125 disk.rbd2.in‚0 cpu‚25.728099277508992! disk.sdb2.out‚535.96142578125 disk.md0.in‚ 67.203125 disk.sda.in‚ 57.765625" proc.memory.availableMB‚1201.5# proc.memory.rssMB‚ 3087.03515625 proc.cpu.threads‚17# disk.nvme1n1.out‚27912.98046875 disk.sda2.in‚ 57.765625 network.sent‚ 8.929415e+06 disk.sdb1.out‚0 disk.rbd2.out‚ 1.341796875) disk./.usagePercent‚83.24683661927412w EŸÝ‚(:” ¦«èÔ“žË« gpu.0.gpu‚62.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚237.326' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚59.331500000000005 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0~ÞóeÞ‚(:Ú ¦«èÔÕ±å« disk.dm-0.out‚ 59095.2734375 disk.sda.out‚ 537.482421875 disk.md0.out‚ 517.75390625 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 1.341796875 disk.sdb2.in‚9.4375 proc.cpu.threads‚17 disk.sdb.in‚9.4375 disk.rbd2.in‚0) proc.memory.availableMB‚ 1201.55078125) proc.memory.percent‚18.84176731109619 cpu‚25.72753440047451 disk.sda2.out‚ 537.482421875 network.sent‚ 9.017397e+06# disk.nvme0n1.out‚30966.26171875 disk.nvme1n1.in‚ 32.45703125$ memory_percent‚92.66631603240967 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125 disk.sdb1.out‚0 disk.sda.in‚ 57.765625 disk.sdb.out‚ 537.482421875$ disk./.usageGB‚2977.310085296631 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚28129.01171875 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 517.75390625 disk.sdb1.in‚0 disk.rbd0.in‚0 disk.rbd0.out‚ 1.25439453125 disk.sda1.in‚0 disk.sda1.out‚0# proc.memory.rssMB‚ 3087.03515625 disk.sdb2.out‚ 537.482421875 network.recv‚ 1.534563e+06) disk./.usagePercent‚83.24683608597147%§Ï™žß‚(:“ µ«èÔÊÜ…« gpu.0.gpu‚81.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚117.81' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚29.452499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚06+Fdà‚(:Ù µ«èÔ–ªÜ«" disk.nvme0n1.out‚ 31058.7734375 disk.sdb.out‚539.0224609375 disk.sda.out‚539.0224609375# proc.memory.rssMB‚ 3087.03515625 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.md0.out‚ 519.25390625 disk.md0p1.in‚ 67.203125 disk.sdb1.in‚0 cpu‚25.727286984597264 network.sent‚ 9.024185e+06 network.recv‚ 1.539712e+06( disk./.usagePercent‚83.2391505546689 disk.sdb2.out‚539.0224609375 disk.dm-0.in‚ 253.32421875" disk.nvme1n1.out‚ 28261.2109375 disk.sdb2.in‚9.4375 disk.dm-0.out‚ 59319.984375 disk.rbd2.in‚0( proc.memory.availableMB‚ 1201.4453125 proc.cpu.threads‚17$ disk./.usageGB‚2977.035213470459 disk.sda1.in‚0 disk.sdb.in‚9.4375 disk.rbd2.out‚ 1.341796875 disk.sda.in‚ 57.765625 disk.sda2.in‚ 57.765625 disk.sda2.out‚539.0224609375 disk.md0p1.out‚ 519.25390625 disk.rbd0.in‚0 disk.sdb1.out‚0 disk.sda1.out‚0 disk.md0.in‚ 67.203125 disk.rbd0.out‚ 1.2783203125$ memory_percent‚92.66695976257324) proc.memory.percent‚18.84176731109619ÏfE£2á- _wandbruntime‚4664  _runtime‚46642üÐ3Éâà ' lr-AdamW/pg1‚0.00030777979333756285 ' lr-AdamW/pg2‚0.00030777979333756285 trainer/global_step‚4199 % _timestamp‚1.7884830128839128e+09 _runtime‚4664.994135862 _step‚338¼èwúÎãÈ ' lr-AdamW/pg1‚0.00030777979333756285 ' lr-AdamW/pg2‚0.00030777979333756285 trainer/global_step‚4199 % _timestamp‚1.7884830128839128e+09 _runtime‚4664.994135862 _step‚338ÒSÿî|2ä- _wandbruntime‚4664  _runtime‚4664wyHNò'åìO WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚75785108 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚552 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚493568942020608 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚564767305419312 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚579098567408640 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚549 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4598406928384 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚21808190 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚579098567408640 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4582967435338 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚75785110 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚579097766892544 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚339 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚21808739 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 % _timestamp‚1.7884830128852103e+09 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚574499377003520 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 168719396 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚498553504236544 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚47124443 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚579097766892544 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚68932630 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚92957560 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚493568966924288 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4984537312256 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4984383362048 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚569351054336534.6tL÷'æñO HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚47124440 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚569350255815290 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4598406928384 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚574499359964160 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4599190405120 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚92934288 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚564767288379952 _runtime‚4664.998878054 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4599190405120 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚574499377003520 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚574499359964160 trainer/global_step‚4199 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚579097766892544 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚68932630 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚92957560 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚493568966924288 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 4984537312256 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 4984383362048 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚569351054336534 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚75785108 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚552 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚493568942020608 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚564767305419312 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚579098567408640 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚549 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 283117056 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4598406928384 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚21808190 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚579098567408640 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4582967435338 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚75785110 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚579097766892544 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚339 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚21808739 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 % _timestamp‚1.7884830128852103e+09 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚574499377003520 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 168719396 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚498553504236544 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚47124443 J8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 _step‚340 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚574632111276032 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4985699723264 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚75802560 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚92979274 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚68948522 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4985549980672 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚569482767283108 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚47135200 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚579232385072640 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚92955976 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚545 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚493683085823488 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 168781836 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚92955976 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚569481968761656 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚574632128315392 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚75802562Lø'ëúM UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚92955976 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚569481968761656 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚574632128315392 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚75802562 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 283117056 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4584030180664 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚574632128315392 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚68949070 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 _runtime‚4665.857187533 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚579231584543232 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 168781836 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 168758536 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚92979274 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4599473267200 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚498668810450432 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚493683110727168 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚564897955620352 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 trainer/global_step‚4199 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 _step‚340 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚574632111276032 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 4985699723264 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚75802560 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚92979274 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚68948522 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 4985549980672 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚569482767283108 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚47135200 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚579232385072640 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚92955976 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚545 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚493683085823488 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 168781836Ô™iÏ2ì- _wandbruntime‚4665  _runtime‚4665 XíÒ 0loss/SRqqt3/detection_loss‚2.429558529488502 trainer/global_step‚4199 2loss/SRqqt4/assignment_loss‚1.4326712966517166 .loss/FRt3/detection_loss‚3.391778284189652 _step‚341 2loss/SRqqt2/assignment_loss‚1.5208512660373399 /loss/FRt1/detection_loss‚1.5624046981045343 1loss/SRqqt4/detection_loss‚2.3148907003579318 /loss/FRt2/assignment_loss‚1.957781494810031 0loss/FRt4/assignment_loss‚2.9908400001106683 2loss/SRqqt3/assignment_loss‚1.7126884322553393 % _timestamp‚1.7884830137486615e+09 /loss/FRt1/assignment_loss‚1.527318271039759 /loss/FRt3/assignment_loss‚3.063339970549759 2loss/SRqqt1/assignment_loss‚0.9128071180943932 /loss/FRt2/detection_loss‚1.9961107101004858 .loss/FRt4/detection_loss‚2.089901544240682 .loss/FBt3/detection_loss‚2.532411998510361 .loss/FBt4/detection_loss‚2.175861186214856 0loss/FBt2/assignment_loss‚0.2781972512601889 0loss/FBt4/assignment_loss‚0.2685236825156413 _runtime‚ 4665.85868862 1loss/FBt3/assignment_loss‚0.40767662152211415 1loss/SRqqt1/detection_loss‚0.8520270796226603 .loss/FBt2/detection_loss‚1.255850735931627 &loss/total_loss‚38.717397715901086 epoch‚6 1loss/FBt1/assignment_loss‚0.13626600806444206 1loss/SRqqt2/detection_loss‚1.1885487482751775 /loss/FBt1/detection_loss‚0.7190920879532184 ²Ý£]î× _runtime‚ 4665.85868862 1loss/FBt3/assignment_loss‚0.40767662152211415 1loss/SRqqt1/detection_loss‚0.8520270796226603 .loss/FBt2/detection_loss‚1.255850735931627 &loss/total_loss‚38.717397715901086 epoch‚6 1loss/FBt1/assignment_loss‚0.13626600806444206 1loss/SRqqt2/detection_loss‚1.1885487482751775 /loss/FBt1/detection_loss‚0.7190920879532184 0loss/SRqqt3/detection_loss‚2.429558529488502 trainer/global_step‚4199 2loss/SRqqt4/assignment_loss‚1.4326712966517166 .loss/FRt3/detection_loss‚3.391778284189652 _step‚341 2loss/SRqqt2/assignment_loss‚1.5208512660373399 /loss/FRt1/detection_loss‚1.5624046981045343 1loss/SRqqt4/detection_loss‚2.3148907003579318 /loss/FRt2/assignment_loss‚1.957781494810031 0loss/FRt4/assignment_loss‚2.9908400001106683 2loss/SRqqt3/assignment_loss‚1.7126884322553393 % _timestamp‚1.7884830137486615e+09 /loss/FRt1/assignment_loss‚1.527318271039759 /loss/FRt3/assignment_loss‚3.063339970549759 2loss/SRqqt1/assignment_loss‚0.9128071180943932 /loss/FRt2/detection_loss‚1.9961107101004858 .loss/FRt4/detection_loss‚2.089901544240682 .loss/FBt3/detection_loss‚2.532411998510361 .loss/FBt4/detection_loss‚2.175861186214856 0loss/FBt2/assignment_loss‚0.2781972512601889 0loss/FBt4/assignment_loss‚0.2685236825156413Õñp_Ÿï‚(:” Ó«èÔ󅟪 gpu.0.gpu‚69.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚222.636' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚55.659000000000006 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0YJoÉkð‚(:à Ó«èÔûÔÒª disk.md0.out‚ 522.66796875 disk.dm-0.out‚ 59689.5078125% disk./.usageGB‚2976.8792991638184 disk.md0p1.out‚ 522.66796875# proc.memory.rssMB‚ 3087.03515625) proc.memory.percent‚18.84176731109619 network.sent‚ 9.102935e+06# disk.nvme0n1.out‚31128.04296875 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚542.58642578125 disk.rbd2.in‚0 network.recv‚ 1.548946e+06 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.4375 disk.rbd0.out‚ 1.34130859375 disk.rbd2.out‚ 1.341796875& proc.memory.availableMB‚ 1201.15625 cpu‚25.726595636684173) disk./.usagePercent‚83.23479112540002 disk.sda.in‚ 57.765625 disk.sda1.in‚0# disk.nvme1n1.out‚28561.46484375 disk.dm-0.in‚ 253.32421875 disk.sda.out‚542.58642578125 disk.sda1.out‚0 disk.sdb.in‚9.4375! disk.sdb2.out‚542.58642578125! disk.sda2.out‚542.58642578125 disk.md0p1.in‚ 67.203125# memory_percent‚92.6687240600586 proc.cpu.threads‚17 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125ð›öœñ‚(:‘ â«èԙ㙫 gpu.0.gpu‚2.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚241.909' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚60.47724999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0GÌ÷S^ò‚(:Ó â«èÔûŒÓ«" disk.nvme1n1.out‚ 28682.6953125 disk.sdb.out‚ 544.173828125$ memory_percent‚92.67466068267822 network.recv‚ 1.55329e+06 disk.sdb1.out‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875) disk./.usagePercent‚83.21366348721575 disk.dm-0.in‚ 253.32421875 disk.sda1.in‚0 disk.sdb2.out‚ 544.173828125* proc.memory.percent‚18.847990036010742 disk.sda2.in‚ 57.765625 disk.sda2.out‚ 544.173828125 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚524.1875 disk.sda.in‚ 57.765625# disk.nvme0n1.out‚31181.06640625 disk.sdb.in‚9.4375" proc.memory.rssMB‚ 3088.0546875 disk.rbd0.in‚0 disk.dm-0.out‚59863.76171875) proc.memory.availableMB‚ 1200.18359375 cpu‚25.727768107045055 proc.cpu.threads‚17 network.sent‚ 9.178385e+06% disk./.usageGB‚2976.1236724853516 disk.sdb2.in‚9.4375 disk.rbd0.out‚ 1.34130859375 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.md0.in‚ 67.203125 disk.rbd2.out‚ 1.341796875 disk.sda.out‚ 544.173828125 disk.nvme1n1.in‚ 32.45703125 disk.md0.out‚524.1875ýÉ>’ó‚(:‡ ñ«èÔˆ¹îª gpu.0.gpu‚2.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚242.558' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚60.6395 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0GÖgj\ô‚(:Ñ ñ«èÔƒ¯¥« disk.md0p1.out‚525.6875 network.recv‚ 1.558228e+06 disk.dm-0.out‚59991.41015625 disk.sdb.out‚ 545.736328125 disk.sdb2.out‚ 545.736328125 disk.rbd0.out‚ 1.404296875$ memory_percent‚92.66808032989502" proc.memory.rssMB‚ 3087.1953125# disk.nvme1n1.out‚28682.94921875 disk.md0.out‚525.6875* proc.memory.percent‚18.842744827270508 proc.cpu.threads‚17 disk.sda1.out‚0 network.sent‚ 9.187274e+06" disk.nvme0n1.out‚ 31308.4609375 disk.rbd0.in‚0) proc.memory.availableMB‚ 1201.26171875 disk.sda.out‚ 545.736328125 disk.sdb2.in‚9.4375 disk.sda2.out‚ 545.736328125 disk.md0p1.in‚ 67.203125 disk.sda2.in‚ 57.765625) disk./.usagePercent‚83.21715107329507 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 1.341796875 disk.sdb1.in‚0 cpu‚25.740694295445604 disk.sdb1.out‚0 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sda.in‚ 57.765625$ disk./.usageGB‚2976.248405456543 disk.md0.in‚ 67.203125 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375˧¤“õ‚(:ˆ €¬èÔ‘ãÝ© gpu.0.gpu‚86.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚246.004' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚61.501 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÊÝ'kö‚(:à €¬èÔ»½Ú« disk.sda2.in‚ 57.765625$ memory_percent‚92.66870021820068 disk.sdb1.out‚0! disk.sdb2.out‚547.69189453125! disk.sda2.out‚547.69189453125 disk.md0p1.in‚ 67.203125" proc.memory.rssMB‚ 3087.1953125* proc.memory.percent‚18.842744827270508 disk.sda.in‚ 57.765625 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚28683.05078125 network.recv‚ 1.561673e+06 disk.sdb1.in‚0 disk.sdb.out‚547.69189453125 disk.rbd0.in‚0 disk.rbd0.out‚ 1.404296875 disk.rbd2.in‚0 network.sent‚ 9.192422e+06 disk.sdb.in‚9.4375 disk.md0.out‚ 527.5703125 disk.dm-0.out‚60087.58984375 proc.cpu.threads‚17 disk.sda.out‚547.69189453125 disk.sda1.in‚0 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875) proc.memory.availableMB‚ 1201.16015625 cpu‚25.754108010401907" disk.nvme0n1.out‚ 31404.5390625 disk.md0p1.out‚ 527.5703125 disk.rbd2.out‚ 1.341796875) disk./.usagePercent‚83.21715171325826% disk./.usageGB‚2976.2484283447266 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125m>¶l2÷- _wandbruntime‚4736  _runtime‚4736–\A_!øù§ =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.43853065371513367 6 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.995830774307251 & Purity/0FRt2SRqqt1FBt/FBt_purity‚1 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2565034031867981 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2222222238779068 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.02655673958361149 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.18999110162258148 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 jet/accuracy_6_of_6‚0 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.18518519401550293 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.28035715222358704 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 7 Purity/*FRt*SRqqt4FBt/FBt_purity‚0.9166666865348816 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.7111111283302307 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.021997693926095963 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.42307692766189575 & Purity/3FRt4SRqqt*FBt/FRt_purity‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 * Purity/4FRt*SRqqt*FBt/FRt_purity‚0.125 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2222222238779068 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4417059123516083 jet/accuracy_6_of_7‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5562852621078491 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 +"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.25 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.16784721612930298 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4347740411758423 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4807876944541931 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.17632851004600525 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5138888955116272 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_2_of_7‚0.5 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 +jet/accuracy_3_of_5‚0.08821116387844086 & Purity/3FRt4SRqqt0FBt/FRt_purity‚0 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 * Purity/4FRt*SRqqt0FBt/FRt_purity‚0.125 :"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.39277520775794983 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9776785969734192 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.01785714365541935 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 9"Purity/*FRt1SRqqt*FBt/event_purity‚0.1921444833278656 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.025698412209749222 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.062261901795864105 8"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.466654896736145 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.3722222149372101 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8744856715202332 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4858374297618866 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 (particle/accuracy‚0.8524026274681091 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 7 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.2176729142665863 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.34374040365219116 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.18898381292819977 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 7 Purity/2FRt1SR*Z€ß}qqt*FBt/FBt_purity‚0.9964157938957214 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_5_of_6‚1 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.2053571492433548 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 6 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.986278772354126 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9889442324638367 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 <"Purity/2FRt1SRqqt*FBt/event_purity‚0.0016977929044514894 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.26158154010772705 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.029608573764562607 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.4320065975189209 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.5809845328330994 :"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.42500004172325134 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3203125 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 +"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.75 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5402109026908875 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9270833134651184 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9664204716682434 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 jet/accuracy_3_of_7‚0.5 particle/accuracy_5_of_7‚1 particle/accuracy_6_of_7‚1 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9978985786437988 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.4656752347946167 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 *jet/accuracy_1_of_3‚0.8539039492607117 +jet/accuracy_4_of_6‚0.09649123251438141 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.48425495624542236 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 7"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.80952388048172 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.42920517921447754 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.44977423548698425 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 :"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.49074074625968933 'particle/f_score‚0.4208482801914215 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4362698495388031 8"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.461769163608551 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.20666666328907013 particle/accuracy_6_of_6‚1 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.42990630865097046 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9920276403427124 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.20685254037380219 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.06417211145162582 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.44999998807907104 _runtime‚4736.120470725 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.19226191937923431 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.35599884390830994 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 jet/accuracy_5_of_7‚0 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 )loss/val_total_loss‚38.60091871391602 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9876488447189331 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 particle/accuracy_5_of_5‚1 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.2667713761329651 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0011947430903092027 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6413111686706543 9"Purity/0FRt1SRqqt1FBt/event_purity‚0.1664043515920639 + Purity/1FRt*SRqqt3FBt/FRt_purity‚0.6875 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.18431900441646576 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.07857143133878708 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.2916666865348816 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23308342695236206 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.012361214496195316 & Purity/*FRt1SRqqt4FBt/FBt_purity‚1 7 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.2095130980014801 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 9"Purity/1FRt0SRqqt2FBt/event_purity‚0.1474197804927826 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.02150537632405758 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_3_of_7‚1 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 7 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.2154531329870224 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.24251623451709747 8"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.516893744468689 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.01907658949494362 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 :"Purity/*FRt1SRqqt2FBt/event_purity‚0.04523612558841705 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.46929827332496643 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.4019230902194977 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22022970020771027 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.009424415417015553 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 9"Purity/1FRt*SRqqt1FBt/event_purity‚0.1667209267616272 8"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.531694769859314 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3021732270717621 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9855260252952576 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.42920517921447754 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.18158423900604248 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03787878900766373 *jet/accuracy_1_of_2‚0.7357724905014038 particle/accuracy_1_of_1‚1 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9022223949432373 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 jet/accuracy_5_of_5‚0 particle/accuracy_3_of_4‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9860561490058899 particle/accuracy_4_of_5‚1 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.1428571492433548 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.8965518474578857 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6666666865348816 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8102099299430847 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 *jet/accuracy_1_of_5‚0.9584714770317078 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.24101264774799347 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.22700132429599762 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2160906344652176 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_4‚1 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9903550148010254 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5663264989852905 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4615384638309479 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.29591599106788635 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0014662756584584713 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3222222328186035 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.34436890482902527 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.46929827332496643 9"Purity/*FRt0SRqqt0FBt/event_purity‚0.1819917857646942 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6785714030265808 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3055555820465088 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 9"Purity/1FRt0SRqqt0FBt/event_purity‚0.2154531329870224 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 particle/accuracy_1_of_5‚1 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.20896916091442108 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9955712556838989 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4640590250492096 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.03181818127632141 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 * Purity/*FRt4SRqqt0FBt/FRt_purity‚0.125 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.10432717949151993 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.26923078298568726 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.30000001192092896 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5319583415985107 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4663432240486145 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3463659882545471 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19381555914878845 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.3333333134651184 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 $ _timestamp‚1.788483084006869e+09 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.23230868577957153 6 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.208847776055336 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 *jet/accuracy_2_of_6‚0.5701754093170166 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6960809826850891 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.4735720157623291 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_7‚1 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.5927420258522034 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.3459325432777405 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6764705777168274 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9047620892524719 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9875453114509583 :"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.33201056718826294 :"Purity/1FRt1SRqqt2FBt/event_purity‚0.02500000037252903 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7236841917037964 +particle/sensitivity‚0.3434358835220337 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ,jet/accuracy_4_of_5‚0.008064515888690948 7validation_average_jet_accuracy‚0.42215481400489807 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.004608294926583767 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9938415884971619 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.24358974397182465 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 9"Purity/*FRt*SRqqt3FBt/event_purity‚0.1666666716337204 :"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.46324214339256287 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.47845205664634705 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.06241923198103905 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5232173204421997 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2922414243221283 *jet/accuracy_3_of_6‚0.1666666716337204 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9982966184616089 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04301847517490387 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 ,"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.625 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.41372644901275635 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.3214285671710968 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.3585052490234375 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3881674110889435 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.4000000059604645 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/2FRt*SRqqt*FBt/event_purity‚0.00986432284116745 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.6050595641136169 particle/accuracy_4_of_7‚1 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09716828167438507 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 +jet/accuracy_2_of_5‚0.47798195481300354 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 trainer/global_step‚4227 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 epoch‚6 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9896115064620972 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.25584641098976135 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11418426781892776 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4183673560619354 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9873340725898743 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3476797938346863 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 * Purity/*FRt4SRqqt*FBt/FRt_purity‚0.125 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.40244922041893005 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 +jet/accuracy_2_of_2‚0.10753509402275085 particle/accuracy_1_of_2‚1 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.17364399135112762 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9842944145202637 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 :"Purity/2FRt0SRqqt0FBt/event_purity‚0.01215880922973156 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.46961894631385803 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.30000001192092896 9"Purity/*FRt1SRqqt1FBt/event_purity‚0.1031625047326088 ;"Purity/3FRt*SRqqt*FBt/event_purity‚0.008192525245249271 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.17916667461395264 particle/accuracy_3_of_6‚1 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 5 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.89682537317276 :"Purity/1FRt1SRqqt0FBt/event_purity‚0.01647115871310234 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 *jet/accuracy_2_of_4‚0.3544233739376068 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.19145511090755463 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 :"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.38336506485939026 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.22427034378051758 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.40478745102882385 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2136457860469818 6 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.996773362159729 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.17291004955768585 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4423759877681732 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5166980624198914 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5287445783615112 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 & Purity/1FRt1SRqqt4FBt/FBt_purity‚1 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9978985786437988 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 particle/accuracy_1_of_4‚1 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.3333333432674408 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4602729380130768 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.19607841968536377 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 8"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.445993572473526 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.42523494362831116 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,jet/accuracy_3_of_3‚0.028568187728524208 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9933744668960571 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.6190476417541504 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.29863280057907104 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.47007986903190613 7 Purity/2FRt0SRqqt1FBt/FBt_purity‚0.9952381253242493 jet/accuracy_7_of_7‚0 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.41388094425201416 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 & Purity/1FRt*SRqqt4FBt/FBt_purity‚1 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9896818399429321 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4529716670513153 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.2977758049964905 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.39451006054878235 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.14814814925193787 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 ("Purity/1FRt2SRqqt1FBt/event_purity‚0 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5133333802223206 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.17871543765068054 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5362346172332764 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.28125 +"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.25 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4343518912792206 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 _step‚342 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.4612036347389221 :"Purity/2FRt*SRqqt0FBt/event_purity‚0.00416928343474865 8"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.426358163356781 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚0 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.1428571492433548 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.18000000715255737 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.28125 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.17173577845096588 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 particle/accuracy_1_of_7‚1 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.004608294926583767 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.27433258295059204 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9921533465385437 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7061403393745422 *jet/accuracy_1_of_4‚0.9160557389259338 jet/accuracy_5_of_6‚0 particle/accuracy_1_of_6‚1 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5035696625709534 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.23200447857379913 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 particle/accuracy_2_of_5‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 8"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.531722903251648 :"Purity/0FRt0SRqqt2FBt/event_purity‚0.33627331256866455 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5413203239440918 *jet/accuracy_1_of_1‚0.4614436626434326 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5933560729026794 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3203125 jet/accuracy_1_of_6‚1 jet/accuracy_1_of_7‚1 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9878386855125427 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9878703355789185 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9946236610412598 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt1FBt/FBt_purity‚0.9981024861335754 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 +"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.25 jet/accuracy_4_of_7‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.6190476417541504 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07383643835783005 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.34666579961776733 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.20162338018417358 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.01785714365541935 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9911379814147949 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5047613382339478 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 particle/accuracy_7_of_7‚1 7"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.80952388048172 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5286354422569275 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2561635375022888 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 6 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.550595223903656 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 6 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.994713544845581 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 :"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.47101446986198425 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 +jet/accuracy_2_of_3‚0.24554964900016785 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5500046014785767 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2591271996498108 particle/accuracy_2_of_6‚1 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.4305555820465088 ,"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.625 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 6 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.173797145485878 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2627519965171814 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979884624481201 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.03074074164032936 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 particle/accuracy_2_of_3‚1 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.34837064146995544 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2237829566001892 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 +particle/specificity‚0.9466084837913513 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5581023097038269 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.4326236844062805 :"Purity/2FRt*SRqqt2FBt/event_purity‚0.04555555433034897 particle/accuracy_4_of_6‚1¬°.ùþ§ ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.2916666865348816 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23308342695236206 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.012361214496195316 & Purity/*FRt1SRqqt4FBt/FBt_purity‚1 7 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.2095130980014801 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.000‚ð’ù3780241822823882 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 *"Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0.5 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 9"Purity/1FRt0SRqqt2FBt/event_purity‚0.1474197804927826 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.02150537632405758 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_3_of_7‚1 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 7 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.2154531329870224 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.24251623451709747 8"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.516893744468689 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.01907658949494362 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚1 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 :"Purity/*FRt1SRqqt2FBt/event_purity‚0.04523612558841705 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.46929827332496643 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.4019230902194977 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22022970020771027 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.009424415417015553 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 9"Purity/1FRt*SRqqt1FBt/event_purity‚0.1667209267616272 8"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.531694769859314 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3021732270717621 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9855260252952576 :"Purity/0FRt1SRqqt0FBt/event_purity‚0.42920517921447754 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.18158423900604248 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03787878900766373 *jet/accuracy_1_of_2‚0.7357724905014038 particle/accuracy_1_of_1‚1 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9022223949432373 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 jet/accuracy_5_of_5‚0 particle/accuracy_3_of_4‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9860561490058899 particle/accuracy_4_of_5‚1 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.1428571492433548 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.8965518474578857 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6666666865348816 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8102099299430847 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 *jet/accuracy_1_of_5‚0.9584714770317078 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.24101264774799347 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.22700132429599762 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2160906344652176 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_4‚1 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9903550148010254 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5663264989852905 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4615384638309479 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.29591599106788635 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0014662756584584713 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 7 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.3222222328186035 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.34436890482902527 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.46929827332496643 9"Purity/*FRt0SRqqt0FBt/event_purity‚0.1819917857646942 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6785714030265808 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3055555820465088 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 9"Purity/1FRt0SRqqt0FBt/event_purity‚0.2154531329870224 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 particle/accuracy_1_of_5‚1 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.20896916091442108 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9955712556838989 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4640590250492096 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.03181818127632141 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ("Purity/4FRt*SRqqt0FBt/SRqqt_purity‚1 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 * Purity/*FRt4SRqqt0FBt/FRt_purity‚0.125 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.10432717949151993 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.26923078298568726 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚1 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.30000001192092896 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5319583415985107 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4663432240486145 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.3463659882545471 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19381555914878845 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.3333333134651184 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 & Purity/1FRt3SRqqt2FBt/FRt_purity‚1 $ _timestamp‚1.788483084006869e+09 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9285714030265808 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.23230868577957153 6 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.208847776055336 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 *jet/accuracy_2_of_6‚0.5701754093170166 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.6960809826850891 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.4735720157623291 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_7‚1 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.5927420258522034 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.3459325432777405 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6764705777168274 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9047620892524719 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9875453114509583 :"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.33201056718826294 :"Purity/1FRt1SRqqt2FBt/event_purity‚0.02500000037252903 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7236841917037964 +particle/sensitivity‚0.3434358835220337 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ,jet/accuracy_4_of_5‚0.008064515888690948 7validation_average_jet_accuracy‚0.42215481400489807 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.004608294926583767 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9938415884971619 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.24358974397182465 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/SRqqt_purity‚1 9"Purity/*FRt*SRqqt3FBt/event_purity‚0.1666666716337204 :"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.46324214339256287 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.47845205664634705 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.06241923198103905 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5232173204421997 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.2922414243221283 *jet/accuracy_3_of_6‚0.1666666716337204 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9982966184616089 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04301847517490387 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 ,"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.625 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.41372644901275635 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.3214285671710968 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.3585052490234375 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3881674110889435 9"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.4000000059604645 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 :"Purity/2FRt*SRqqt*FBt/event_purity‚0.00986432284116745 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.6050595641136169 particle/accuracy_4_of_7‚1 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09716828167438507 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 +jet/accuracy_2_of_5‚0.47798195481300354 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 trainer/global_step‚4227 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 epoch‚6 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9896115064620972 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.25584641098976135 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11418426781892776 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4183673560619354 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9873340725898743 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3476797938346863 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 * Purity/*FRt4SRqqt*FBt/FRt_purity‚0.125 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.40244922041893005 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 +jet/accuracy_2_of_2‚0.10753509402275085 particle/accuracy_1_of_2‚1 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.17364399135112762 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9842944145202637 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 :"Purity/2FRt0SRqqt0FBt/event_purity‚0.01215880922973156 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.46961894631385803 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.30000001192092896 9"Purity/*FRt1SRqqt1FBt/event_purity‚0.1031625047326088 ;"Purity/3FRt*SRqqt*FBt/event_purity‚0.008192525245249271 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.17916667461395264 particle/accuracy_3_of_6‚1 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 5 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.89682537317276 :"Purity/1FRt1SRqqt0FBt/event_purity‚0.01647115871310234 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 *jet/accuracy_2_of_4‚0.3544233739376068 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 8 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.19145511090755463 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 :"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.38336506485939026 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.22427034378051758 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.40478745102882385 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2136457860469818 6 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.996773362159729 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.17291004955768585 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4423759877681732 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5166980624198914 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5287445783615112 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 & Purity/1FRt1SRqqt4FBt/FBt_purity‚1 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9978985786437988 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 particle/accuracy_1_of_4‚1 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.3333333432674408 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4602729380130768 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.19607841968536377 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 8"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.445993572473526 ("Purity/2FRt1SRqqt0FBt/event_purity‚0 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.42523494362831116 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,jet/accuracy_3_of_3‚0.028568187728524208 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9933744668960571 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.6190476417541504 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.29863280057907104 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.47007986903190613 7 Purity/2FRt0SRqqt1FBt/FBt_purity‚0.9952381253242493 jet/accuracy_7_of_7‚0 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.41388094425201416 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 & Purity/1FRt*SRqqt4FBt/FBt_purity‚1 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9896818399429321 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4529716670513153 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.2977758049964905 :"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.39451006054878235 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.14814814925193787 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 ("Purity/1FRt2SRqqt1FBt/event_purity‚0 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5133333802223206 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.17871543765068054 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5362346172332764 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.28125 +"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.25 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4343518912792206 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 _step‚342 9"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.4612036347389221 :"Purity/2FRt*SRqqt0FBt/event_purity‚0.00416928343474865 8"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.426358163356781 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚0 7 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.1428571492433548 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.18000000715255737 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.28125 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.17173577845096588 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 particle/accuracy_1_of_7‚1 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.004608294926583767 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.27433258295059204 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9921533465385437 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7061403393745422 *jet/accuracy_1_of_4‚0.9160557389259338 jet/accuracy_5_of_6‚0 particle/accuracy_1_of_6‚1 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5035696625709534 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.23200447857379913 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 particle/accuracy_2_of_5‚1 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 8"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.531722903251648 :"Purity/0FRt0SRqqt2FBt/event_purity‚0.33627331256866455 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5413203239440918 *jet/accuracy_1_of_1‚0.4614436626434326 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.5933560729026794 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.3203125 jet/accuracy_1_of_6‚1 jet/accuracy_1_of_7‚1 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9878386855125427 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9878703355789185 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9946236610412598 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt1FBt/FBt_purity‚0.9981024861335754 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 +"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.25 jet/accuracy_4_of_7‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.6190476417541504 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.07383643835783005 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.34666579961776733 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.20162338018417358 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.01785714365541935 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9911379814147949 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.5047613382339478 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 particle/accuracy_7_of_7‚1 7"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.80952388048172 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 9"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.5286354422569275 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2561635375022888 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 6 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.550595223903656 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 6 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.994713544845581 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 :"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.47101446986198425 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 +jet/accuracy_2_of_3‚0.24554964900016785 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5500046014785767 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2591271996498108 particle/accuracy_2_of_6‚1 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.4305555820465088 ,"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.625 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 6 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.173797145485878 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2627519965171814 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979884624481201 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.03074074164032936 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 particle/accuracy_2_of_3‚1 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.34837064146995544 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2237829566001892 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 +particle/specificity‚0.9466084837913513 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5581023097038269 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.4326236844062805 :"Purity/2FRt*SRqqt2FBt/event_purity‚0.04555555433034897 particle/accuracy_4_of_6‚1 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.43853065371513367 6 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.995830774307251 & Purity/0FRt2SRqqt1FBt/FBt_purity‚1 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2565034031867981 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2222222238779068 ) Purity/4FRt1SRqqt0FBt/FRt_purity‚0.25 :"Purity/2FRt0SRqqt*FBt/event_purity‚0.02655673958361149 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.18999110162258148 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 jet/accuracy_6_of_6‚0 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.18518519401550293 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.28035715222358704 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 7 Purity/*FRt*SRqqt4FBt/FBt_purity‚0.9166666865348816 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 9"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.7111111283302307 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.021997693926095963 :"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.42307692766189575 & Purity/3FRt4SRqqt*FBt/FRt_purity‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 * Purity/4FRt*SRqqt*FBt/FRt_purity‚0.125 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2222222238779068 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4417059123516083 jet/accuracy_6_of_7‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5562852621078491 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 +"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.25 ) Purity/4FRt1SRqqt*FBt/FRt_purity‚0.25 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.16784721612930298 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4347740411758423 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4807876944541931 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.17632851004600525 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5138888955116272 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_2_of_7‚0.5 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 +jet/accuracy_3_of_5‚0.08821116387844086 & Purity/3FRt4SRqqt0FBt/FRt_purity‚0 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 * Purity/4FRt*SRqqt0FBt/FRt_purity‚0.125 :"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.39277520775794983 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9776785969734192 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.01785714365541935 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 9"Purity/*FRt1SRqqt*FBt/event_purity‚0.1921444833278656 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.025698412209749222 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.062261901795864105 8"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.466654896736145 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.3722222149372101 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8744856715202332 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4858374297618866 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 (particle/accuracy‚0.8524026274681091 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 7 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.2176729142665863 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.34374040365219116 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.18898381292819977 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_5_of_6‚1 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.2053571492433548 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 6 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.986278772354126 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9889442324638367 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 <"Purity/2FRt1SRqqt*FBt/event_purity‚0.0016977929044514894 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.26158154010772705 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.029608573764562607 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.4320065975189209 9"Purity/1FRt1SRqqt1FBt/å zùSRqqt_purity‚0.5809845328330994 :"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.42500004172325134 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3203125 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 +"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.75 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5402109026908875 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9270833134651184 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9664204716682434 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 jet/accuracy_3_of_7‚0.5 particle/accuracy_5_of_7‚1 particle/accuracy_6_of_7‚1 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9978985786437988 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 9"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.4656752347946167 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 *jet/accuracy_1_of_3‚0.8539039492607117 +jet/accuracy_4_of_6‚0.09649123251438141 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.48425495624542236 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 7"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.80952388048172 :"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.42920517921447754 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 :"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.44977423548698425 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 :"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.49074074625968933 'particle/f_score‚0.4208482801914215 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚1 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4362698495388031 8"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.461769163608551 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.20666666328907013 particle/accuracy_6_of_6‚1 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.42990630865097046 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9920276403427124 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.20685254037380219 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.06417211145162582 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.44999998807907104 _runtime‚4736.120470725 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.19226191937923431 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.35599884390830994 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 jet/accuracy_5_of_7‚0 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 )loss/val_total_loss‚38.60091871391602 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9876488447189331 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.35555556416511536 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 particle/accuracy_5_of_5‚1 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.2667713761329651 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0011947430903092027 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6413111686706543 9"Purity/0FRt1SRqqt1FBt/event_purity‚0.1664043515920639 + Purity/1FRt*SRqqt3FBt/FRt_purity‚0.6875 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.18431900441646576 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.07857143133878708ÖÌ䛕ú‚(:Š ¬èÔçШ¬ gpu.0.gpu‚84.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚175.235' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚43.80875 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0x —seû‚(:Ú ¬èÔ´ŒÐ« disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.md0.out‚ 529.30859375 disk.rbd0.in‚0 disk.sda.in‚ 57.765625 disk.sda1.out‚0 cpu‚25.76377908077042! disk.sda2.out‚549.49169921875 disk.md0.in‚ 67.203125 disk.rbd0.out‚ 1.404296875 disk.rbd2.in‚0 disk.md0p1.out‚ 529.30859375" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17$ disk./.usageGB‚2976.123260498047 disk.dm-0.out‚ 60172.4765625 disk.rbd2.out‚ 1.341796875 disk.sda1.in‚0) disk./.usagePercent‚83.21365196787829 disk.nvme0n1.out‚ 31489.125 disk.sdb.in‚9.4375 disk.sdb.out‚549.49169921875 disk.sdb2.in‚9.4375! disk.sdb2.out‚549.49169921875 disk.sdb1.in‚0 network.sent‚ 9.209573e+06 disk.dm-0.in‚ 253.32421875$ memory_percent‚92.65878200531006* proc.memory.percent‚18.830537796020508" disk.nvme1n1.out‚ 28683.3515625 disk.sdb1.out‚0 disk.sda.out‚549.49169921875) proc.memory.availableMB‚ 1202.78515625 network.recv‚ 1.566566e+06 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125¦ ÊŸü‚(:” ž¬èÔ§…É© gpu.0.gpu‚60.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚224.584' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚56.145999999999994 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0dþ~feý‚(:Ú ž¬èÔ­ ¶ª) proc.memory.availableMB‚ 1202.76953125 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375 disk.sda2.in‚ 57.765625 disk.rbd0.out‚ 1.404296875 disk.sda1.in‚0 cpu‚25.763123379832944 disk.nvme1n1.in‚ 32.45703125 disk.sda2.out‚550.9794921875 disk.rbd2.out‚ 1.341796875 disk.sda.in‚ 57.765625 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17% disk./.usageGB‚2975.8486709594727# disk.nvme1n1.out‚28683.55078125 disk.sdb.out‚550.9794921875 disk.md0.out‚ 530.7421875* proc.memory.percent‚18.830537796020508 network.sent‚ 9.298263e+06 disk.md0p1.out‚ 530.7421875 disk.sdb1.out‚0 network.recv‚ 1.570819e+06( disk./.usagePercent‚83.2059743294551 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚31589.64453125 disk.md0p1.in‚ 67.203125 disk.sdb1.in‚0 disk.sdb2.out‚550.9794921875 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.sda.out‚550.9794921875 disk.sda1.out‚0# memory_percent‚92.6588773727417 disk.dm-0.out‚ 60273.1953125 Þnâ2þ- _wandbruntime‚4756  _runtime‚4756†>ÃÃÿ½ $ lr-AdamW/pg1‚0.00029279268264632 $ lr-AdamW/pg2‚0.00029279268264632 trainer/global_step‚4249 % _timestamp‚1.7884831043424158e+09 _runtime‚4756.452961081 _step‚343ÅöȀ $ lr-AdamW/pg1‚0.00029279268264632 $ lr-AdamW/pg2‚0.00029279268264632 trainer/global_step‚4249 % _timestamp‚1.7884831043424158e+09 _runtime‚4756.452961081 _step‚343×è‡2- _wandbruntime‚4756  _runtime‚4756E„K¾ñ'‚ëO KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚94307028 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚344 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚77070630 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚506689274115584 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚94283756 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚553 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚583953928901632 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 trainer/global_step‚4249 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚588625237552128 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 193533952 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚94283756 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚588626038068224 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 171377658 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚77070628 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚578621306450031 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 171354384 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 _runtime‚4756.456605968 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚501627107724288 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4671325689856 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚573965649073456 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4656438858459 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚573965666112816 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476`oʇö'ƒðO TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚94307028 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚583953928901632 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚588626038068224 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚556 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚47984161 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚578622104971275 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚70172475 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚506689467649536 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4672109166592 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 168630272 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5062166391296 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚583953911862272 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 _step‚344 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚77070630 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚506689274115584 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚94283756 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚553 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚583953928901632 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 trainer/global_step‚4249 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚588625237552128 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 193533952 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚94283756 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚588626038068224 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 171377658 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚77070628 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚578621306450031 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 171354384 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 _runtime‚4756.456605968 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚501627107724288 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4671325689856 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚573965649073456 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4656438858459 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚573965666112816 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚94307028 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 J¦…öM B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚77088082 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚47994921 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5063317198336 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4672392028672 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚77088082 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚584086680213504 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4672392028672 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚94305444 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚506804751760384 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚584086663174144 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚513 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚588759055202816 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 UHDeviceStatsMonitor.on_train_bŽwÁ²Vatch_end/requested_bytes.large_pool.current‚17039360 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 % _timestamp‚1.7884831052051198e+09 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚94305444 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4673175518720 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚578753817917849 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 171416824 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚574096299274496 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚501741251527168 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚588759855732224 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚77088080 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚22193846 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚584086680213504 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 trainer/global_step‚4249 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 171416824 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚584086663174144 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5063475329536 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚4757.316195205 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 171393524 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚77088080 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚94328742 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚516 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚501741276430848 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚506804568725504 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚22193333 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚70188251 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4673175518720 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 trainer/global_step‚4249 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 171416824 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚584086663174144 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5063475329536 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚4757.316195205 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 171393524 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚77088080 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚94328742 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚516 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚501741276430848 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚506804568725504 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚22193333 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚70188251 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4673175518720 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4672392028672 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚77088082 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚584086680213504 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4672392028672 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚94305444 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚506804751760384 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚584086663174144 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚513 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚588759055202816 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 % _timestamp‚1.7884831052051198e+09 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚94305444 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4673175518720 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚578753817917849 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 171416824 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚574096299274496 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚501741251527168ÙÐbÝž2‡- _wandbruntime‚4757  _runtime‚4757¤ä,]\ˆÖ 2loss/SRqqt1/assignment_loss‚1.0052823218117868 1loss/FBt4/assignment_loss‚0.19783163331995066 1loss/SRqqt2/detection_loss‚1.1526396072336607 1loss/SRqqt3/detection_loss‚2.3587367770387164 .loss/FBt2/detection_loss‚1.985310167632997 epoch‚7 _runtime‚ 4757.3172985 2loss/SRqqt4/assignment_loss‚1.7717602241784334 &loss/total_loss‚38.731178478258876 0loss/FRt2/assignment_loss‚2.2422795712306933 /loss/FRt4/assignment_loss‚2.950015493358175 2loss/SRqqt3/assignment_loss‚1.6330571187409892 0loss/FRt1/assignment_loss‚1.5961668901848343 1loss/FBt2/assignment_loss‚0.07649326294481966 /loss/FRt2/detection_loss‚2.0471287515935717 .loss/FBt3/detection_loss‚2.487300972640514 2loss/SRqqt2/assignment_loss‚1.0763771919148173 0loss/FBt3/assignment_loss‚0.1342945270034761 /loss/FRt1/detection_loss‚1.6587449921962787 1loss/SRqqt4/detection_loss‚2.3726311892271044 /loss/FBt1/detection_loss‚0.5703093134439908 0loss/FBt1/assignment_loss‚0.1117896463137133 /loss/FRt4/detection_loss‚2.1366103046969633 1loss/SRqqt1/detection_loss‚1.0632256690506674 trainer/global_step‚4249 % _timestamp‚1.7884831052071986e+09 _step‚346 0loss/FRt3/assignment_loss‚3.2872765280983667 /loss/FRt3/detection_loss‚2.8039230343067283 .loss/FBt4/detection_loss‚2.011993290097625êêmCa‰Û /loss/FRt4/detection_loss‚2.1366103046969633 1loss/SRqqt1/detection_loss‚1.0632256690506674 trainer/global_step‚4249 % _timestamp‚1.7884831052071986e+09 _step‚346 0loss/FRt3/assignment_loss‚3.2872765280983667 /loss/FRt3/detection_loss‚2.8039230343067283 .loss/FBt4/detection_loss‚2.011993290097625 2loss/SRqqt1/assignment_loss‚1.0052823218117868 1loss/FBt4/assignment_loss‚0.19783163331995066 1loss/SRqqt2/detection_loss‚1.1526396072336607 1loss/SRqqt3/detection_loss‚2.3587367770387164 .loss/FBt2/detection_loss‚1.985310167632997 epoch‚7 _runtime‚ 4757.3172985 2loss/SRqqt4/assignment_loss‚1.7717602241784334 &loss/total_loss‚38.731178478258876 0loss/FRt2/assignment_loss‚2.2422795712306933 /loss/FRt4/assignment_loss‚2.950015493358175 2loss/SRqqt3/assignment_loss‚1.6330571187409892 0loss/FRt1/assignment_loss‚1.5961668901848343 1loss/FBt2/assignment_loss‚0.07649326294481966 /loss/FRt2/detection_loss‚2.0471287515935717 .loss/FBt3/detection_loss‚2.487300972640514 2loss/SRqqt2/assignment_loss‚1.0763771919148173 0loss/FBt3/assignment_loss‚0.1342945270034761 /loss/FRt1/detection_loss‚1.6587449921962787 1loss/SRqqt4/detection_loss‚2.3726311892271044 /loss/FBt1/detection_loss‚0.5703093134439908 0loss/FBt1/assignment_loss‚0.1117896463137133ÚR„Ù”Š‚(:‰ ­¬èÔö«‚¬ gpu.0.gpu‚36.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚121.259' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.31475 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‘@Û¥a‹‚(:Ö ­¬èÔÿšï¬ disk.rbd0.out‚ 1.404296875 disk.sda1.out‚0* proc.memory.percent‚18.830537796020508 proc.cpu.threads‚17 disk.rbd2.in‚0 disk.rbd2.out‚ 1.341796875 disk.nvme0n1.in‚ 220.8671875 network.recv‚ 1.575448e+06 disk.md0p1.in‚ 67.203125 disk.dm-0.out‚60409.66015625 disk.sdb1.in‚0 disk.sda1.in‚0 disk.sdb2.in‚9.4375 disk.sdb2.out‚553.0322265625 cpu‚25.76227479241429 disk.md0.in‚ 67.203125 disk.sda.in‚ 57.765625 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚28776.53515625 disk.sda2.out‚553.0322265625$ disk./.usageGB‚2975.985809326172 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.sda.out‚553.0322265625 disk.sdb.in‚9.4375' proc.memory.availableMB‚ 1202.984375" proc.memory.rssMB‚ 3085.1953125 disk.sda2.in‚ 57.765625 disk.sdb1.out‚0 network.sent‚ 9.317822e+06 disk.md0.out‚ 532.73046875 disk.nvme0n1.out‚ 31633.125 disk.sdb.out‚553.0322265625$ memory_percent‚92.65756607055664) disk./.usagePercent‚83.20980877558488 disk.md0p1.out‚ 532.73046875ˆ%?ÿžŒ‚(:“ ¼¬èԥщ« gpu.0.gpu‚54.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚238.452' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚59.61300000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ŒrÁ‰i‚(:Þ ¼¬èÔŽ©Ç« disk.sdb.out‚554.36083984375 disk.md0.out‚ 534.01171875 disk.sdb1.out‚0 cpu‚25.761318123463283 network.sent‚ 9.393002e+06 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 534.01171875 disk.rbd0.out‚ 1.404296875$ memory_percent‚92.65761375427246! disk.sdb2.out‚554.36083984375" proc.memory.rssMB‚ 3085.1953125 disk.sda1.out‚0 disk.sdb2.in‚9.4375 disk.rbd2.out‚ 1.341796875 disk.dm-0.out‚ 60570.9921875 network.recv‚ 1.579939e+06 disk.sda.in‚ 57.765625 disk.sda2.in‚ 57.765625! disk.sda2.out‚554.36083984375 disk.md0p1.in‚ 67.203125* proc.memory.percent‚18.830537796020508% disk./.usageGB‚2976.0523071289062 disk.sdb.in‚9.4375 disk.rbd0.in‚0" disk.nvme1n1.out‚ 28937.8203125 disk.md0.in‚ 67.203125) disk./.usagePercent‚83.21166808198082 disk.nvme0n1.in‚ 220.8671875! disk.nvme0n1.out‚ 31633.171875 disk.dm-0.in‚ 253.32421875 disk.sdb1.in‚0( proc.memory.availableMB‚ 1202.9765625 proc.cpu.threads‚17 disk.rbd2.in‚0 disk.sda.out‚554.36083984375 disk.sda1.in‚0g攎‚(:‰ ˬèÔŒÑ÷ª gpu.0.gpu‚31.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚230.437' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.60925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0h tpg‚(:Ü ˬèԩ𺫠disk.dm-0.out‚ 60605.0703125 disk.sda.out‚556.03662109375" disk.nvme0n1.out‚ 31633.4140625" proc.memory.rssMB‚ 3085.1953125 network.recv‚ 1.584626e+06 cpu‚25.76050847942086$ disk./.usageGB‚2976.183967590332 disk.sdb.in‚9.4375 disk.rbd2.out‚ 1.341796875 disk.sda.in‚ 57.765625 disk.nvme1n1.out‚ 28971.65625 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚556.03662109375 disk.sda2.in‚ 57.765625! disk.sda2.out‚556.03662109375 disk.nvme0n1.in‚ 220.8671875 proc.cpu.threads‚17 network.sent‚ 9.397209e+06 disk.sdb2.in‚9.4375 disk.md0p1.in‚ 67.203125 disk.sdb1.in‚0 disk.sda1.out‚0$ memory_percent‚92.65906810760498 disk.sdb.out‚556.03662109375* proc.memory.percent‚18.830537796020508) disk./.usagePercent‚83.21534936358647 disk.md0.in‚ 67.203125 disk.md0.out‚ 535.62109375 disk.md0p1.out‚ 535.62109375 disk.rbd0.out‚ 1.404296875 disk.sdb1.out‚0 disk.sda1.in‚0) proc.memory.availableMB‚ 1202.73828125 disk.dm-0.in‚ 253.32421875û>º×2- _wandbruntime‚4808  _runtime‚4808÷“«ÌÅ‘¿ & lr-AdamW/pg1‚0.0002780604941122015 & lr-AdamW/pg2‚0.0002780604941122015 trainer/global_step‚4299 $ _timestamp‚1.788483156089474e+09 _runtime‚ 4808.19981686 _step‚347õ§ögÊ’Ä & lr-AdamW/pg1‚0.0002780604941122015 & lr-AdamW/pg2‚0.0002780604941122015 trainer/global_step‚4299 $ _timestamp‚1.788483156089474e+09 _runtime‚ 4808.19981686 _step‚347ÛI#2“- _wandbruntime‚4808  _runtime‚4808À–Ç`"”ìO LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚595316948430848 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4725453935616 _step‚348 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚95394780 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚580498159125456 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚512 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚22434438 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5119862292480 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚580498176164816 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚590591477455872 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚70956599 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚507334297868288 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚70956087 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚507334322771968 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 _runtime‚4808.206834223 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚512454006210560 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 % _timestamp‚1.7884831560962806e+09 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚95371508 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚590591494495232 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚95394780 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚77943228 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚77943228 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5119708342272 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4709603296767 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4724670458880 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚48522161 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚595316147914752 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚590591494495232 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4708821814883 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚77943230 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚22433929 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚585206980940339 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚509 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4724670458880 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚595316147914752 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚590591494495232 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4708821814883 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚77943230 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚22433929 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚585206980940339 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚509 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4724670458880 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚70956087 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚507334322771968 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 _runtime‚4808.206834223 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚512454006210560 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 % _timestamp‚1.7884831560962806e+09 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚95371508 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3ÜÃÛèP2–- _wandbruntime‚4809  _runtime‚4809ñ·¡2û&—õM RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚95416494 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚77960680 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚70971690 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚585339492408157 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚77960682 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _step‚349 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚95393196 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚70972198 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚512569312622592 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚595449965565440 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚48532918 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚22438772 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4710666042301 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚48532921 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚590724245807104 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 173377176 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚508 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4725736797696 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 $ _timestamp‚1.788483156939137e+09 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5121022791168 trainer/global_step‚4299 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5120870951424 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚95416494 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 173377176 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚508 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4725736797696 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 $ _timestamp‚1.788483156939137e+09 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5121022791168 trainer/global_step‚4299 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5120870951424 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚95416494 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚70971690 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚585339492408157 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚77960682 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _step‚349 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚95393196 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚70972198 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚512569312622592 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚595449965565440 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚48532918 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚22438772 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4710666042301 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚48532921 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚590724245807104 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785Ý&weë2™- _wandbruntime‚4809  _runtime‚4809ãlPçšÖ 0loss/FRt1/assignment_loss‚1.3663788529003367 0loss/FRt3/assignment_loss‚3.5077250117347356 trainer/global_step‚4299 1loss/SRqqt2/assignment_loss‚1.245904853163534 /loss/FRt2/detection_loss‚1.9728007533333518 /loss/FRt4/detection_loss‚2.2749528472335374 1loss/SRqqt1/detection_loss‚0.9288342194372995 /loss/FBt4/detection_loss‚2.5365194211835447 % _timestamp‚1.7884831569418294e+09 /loss/FRt2/assignment_loss‚1.661616862422288 .loss/FRt4/assignment_loss‚3.10776531319075 1loss/SRqqt3/assignment_loss‚1.492852449010719 1loss/FBt3/assignment_loss‚0.48116472543541833 1loss/SRqqt2/detection_loss‚1.1179955590022617 1loss/FBt1/assignment_loss‚0.08869547097777886 1loss/FBt2/assignment_loss‚0.10266400279042405 .loss/FBt1/detection_loss‚0.587488062176553 %loss/total_loss‚38.41930414332548 epoch‚7 2loss/SRqqt4/assignment_loss‚1.5711700201034546 /loss/FRt3/detection_loss‚2.8655706700824557 0loss/SRqqt3/detect\ðÍEuion_loss‚2.372168836810372 _runtime‚4809.051900097 /loss/FBt3/detection_loss‚2.2044553723600178 2loss/SRqqt1/assignment_loss‚0.9585460684288086 /loss/FRt1/detection_loss‚1.9427045771304299 /loss/FBt2/detection_loss‚1.3954905898620684 1loss/FBt4/assignment_loss‚0.09162904184935265 1loss/SRqqt4/detection_loss‚2.5442105627059934 _step‚350&Ü^a›Û 1loss/SRqqt3/assignment_loss‚1.492852449010719 1loss/FBt3/assignment_loss‚0.48116472543541833 1loss/SRqqt2/detection_loss‚1.1179955590022617 1loss/FBt1/assignment_loss‚0.08869547097777886 1loss/FBt2/assignment_loss‚0.10266400279042405 .loss/FBt1/detection_loss‚0.587488062176553 %loss/total_loss‚38.41930414332548 epoch‚7 2loss/SRqqt4/assignment_loss‚1.5711700201034546 /loss/FRt3/detection_loss‚2.8655706700824557 0loss/SRqqt3/detection_loss‚2.372168836810372 _runtime‚4809.051900097 /loss/FBt3/detection_loss‚2.2044553723600178 2loss/SRqqt1/assignment_loss‚0.9585460684288086 /loss/FRt1/detection_loss‚1.9427045771304299 /loss/FBt2/detection_loss‚1.3954905898620684 1loss/FBt4/assignment_loss‚0.09162904184935265 1loss/SRqqt4/detection_loss‚2.5442105627059934 _step‚350 0loss/FRt1/assignment_loss‚1.3663788529003367 0loss/FRt3/assignment_loss‚3.5077250117347356 trainer/global_step‚4299 1loss/SRqqt2/assignment_loss‚1.245904853163534 /loss/FRt2/detection_loss‚1.9728007533333518 /loss/FRt4/detection_loss‚2.2749528472335374 1loss/SRqqt1/detection_loss‚0.9288342194372995 /loss/FBt4/detection_loss‚2.5365194211835447 % _timestamp‚1.7884831569418294e+09 /loss/FRt2/assignment_loss‚1.661616862422288 .loss/FRt4/assignment_loss‚3.10776531319075ÞpÁú}Ÿœ‚(:” Ú¬èÔÈÓª gpu.0.gpu‚67.0 gpu.0.memory‚15, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚225.753' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚56.438250000000004 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0šPq[‚(:Ð Ú¬èÔîÀª network.recv‚ 1.587871e+06 disk.dm-0.in‚ 253.32421875 disk.sda2.in‚ 57.765625* proc.memory.percent‚18.830537796020508 network.sent‚ 9.402385e+06 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.rbd2.out‚ 1.341796875 disk.sda.in‚ 57.765625 disk.sda.out‚557.97509765625 disk.nvme1n1.in‚ 32.45703125) proc.memory.availableMB‚ 1202.81640625 disk.sda1.in‚0 disk.sda1.out‚0" disk.nvme0n1.out‚ 31633.4765625 disk.md0.in‚ 67.203125 disk.md0p1.out‚537.5 cpu‚25.759198323391498! disk.sda2.out‚557.97509765625 disk.md0p1.in‚ 67.203125" proc.memory.rssMB‚ 3085.1953125) disk./.usagePercent‚83.21886073496445 disk.dm-0.out‚ 60706.90625 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚557.97509765625 disk.sdb.in‚9.4375 disk.sdb2.in‚9.4375! disk.sdb2.out‚557.97509765625 disk.md0.out‚537.5$ memory_percent‚92.65859127044678% disk./.usageGB‚2976.3095512390137 disk.rbd0.out‚ 1.404296875" disk.nvme1n1.out‚ 29073.4296875 proc.cpu.threads‚17)Û‘ž‚(:† é¬èÔûáÊ« gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚214.89' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.7225 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0añí|jŸ‚(:ß é¬èÔÂèÙ¬ proc.cpu.threads‚17 disk.sda1.out‚0 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125 disk.dm-0.out‚60834.50390625* proc.memory.percent‚18.830537796020508 disk.dm-0.in‚ 253.32421875 disk.md0p1.out‚ 539.06640625) disk./.usagePercent‚83.22235301410717% disk./.usageGB‚2976.4344520568848 disk.sdb1.out‚0 disk.sda2.in‚ 57.765625 disk.rbd0.out‚ 1.404296875' proc.memory.availableMB‚ 1202.640625 network.recv‚ 1.593436e+06 disk.rbd2.in‚0 disk.sda.out‚559.59521484375 disk.sdb.out‚559.59521484375 disk.md0p1.in‚ 67.203125$ memory_percent‚92.65966415405273 cpu‚25.758015602137917 network.sent‚ 9.489736e+06 disk.sda1.in‚0! disk.nvme1n1.out‚ 29200.796875! disk.sdb2.out‚559.59521484375! disk.sda2.out‚559.59521484375 disk.md0.out‚ 539.06640625 disk.rbd0.in‚0 disk.rbd2.out‚ 1.341796875 disk.sdb1.in‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚31633.70703125 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.4375 disk.sda.in‚ 57.765625" proc.memory.rssMB‚ 3085.1953125Yµ7Ô” ‚(:‰ ø¬èÔîøô© gpu.0.gpu‚47.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚220.909' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.22725 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0› x>i¡‚(:Þ ø¬èÔ̼¥« disk.sda1.in‚0" proc.memory.rssMB‚ 3085.1953125 network.recv‚ 1.596414e+06 disk.nvme0n1.in‚ 220.8671875 disk.dm-0.in‚ 253.32421875 network.sent‚ 9.494006e+06 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125 disk.md0.out‚ 540.7109375 disk.rbd0.out‚ 1.404296875 proc.cpu.threads‚17% disk./.usageGB‚2976.5594520568848 disk.sda.in‚ 57.765625 disk.sda.out‚561.29638671875 disk.sda1.out‚0 disk.sdb.out‚561.29638671875) disk./.usagePercent‚83.22584806642375# disk.nvme0n1.out‚31633.76171875! disk.sda2.out‚561.29638671875 disk.rbd0.in‚0 disk.dm-0.out‚ 61033.671875 disk.rbd2.in‚0 cpu‚25.75728942908957 disk.sdb1.in‚0 disk.sdb2.in‚9.4375! disk.sdb2.out‚561.29638671875 disk.rbd2.out‚ 1.341796875) proc.memory.availableMB‚ 1202.52734375* proc.memory.percent‚18.830537796020508 disk.sdb.in‚9.4375 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 540.7109375$ memory_percent‚92.66035556793213# disk.nvme1n1.out‚29399.91015625ê|þ‚2¢- _wandbruntime‚4859  _runtime‚4859Òw^Ä£¾ _step‚351 % lr-AdamW/pg1‚0.000263595528097593 % lr-AdamW/pg2‚0.000263595528097593 trainer/global_step‚4349 % _timestamp‚1.7884832072105482e+09 _runtime‚ 4859.32413472ë¥0ɤà trainer/global_step‚4349 % _timestamp‚1.7884832072105482e+09 _runtime‚ 4859.32413472 _step‚351 % lr-AdamW/pg1‚0.000263595528097593 % lr-AdamW/pg2‚0.000263595528097593ß½”˜2¥- _wandbruntime‚4859  _runtime‚4859rïW¼ñ'¦ëO UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4778015227904 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚602007058277376 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚523 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚513041512915968 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚587030686216816 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 175275088 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚597229060088832 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚587030669177456 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚78815830 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚518219081290240 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚602007858793472 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚513041488012288 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚591792655430647 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚78815830 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚22681453 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4761986253191 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚96482532 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4778798704640 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4778015227904 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚78815828 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 _runtime‚ 4859.32422422 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚49060161 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚602007858793472 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚602007058277376 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚71741614 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚518218898242048 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚597229043049472 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5177568374272 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚591793453951891 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚597229060088832 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4762767735075 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4778798704640 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚526 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚71741088 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚352 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0Eú¤ö'§ðO KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚513041512915968 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚587030686216816 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 175275088 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚597229060088832 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚587030669177456 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚78815830 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚518219081290240 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚602007858793472 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚513041488012288 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚591792655430647 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚78815830 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚22681453 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4761986253191 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚96482532 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4778798704640 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4778015227904 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚78815828 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 _runtime‚ 4859.32422422 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚49060161 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚602007858793472 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚602007058277376 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚71741614 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚518218898242048 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚597229043049472 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5177568374272 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚591793453951891 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚597229060088832 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4762767735075 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4778798704640 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚526 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚71741088 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚352 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4778015227904 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚602007058277376 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚523 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785àG$}.’¨‚(:‡ ‡­èÔöÍÞª gpu.0.gpu‚48.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚234.164' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.541 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0(g©‚(:Ü ‡­èÔöí®« disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚31634.08984375 disk.rbd2.out‚ 1.341796875 disk.sdb.in‚9.4375! disk.sda2.out‚562.93310546875 disk.md0.out‚ 542.265625) proc.memory.availableMB‚ 1202.42578125 disk.rbd0.in‚0 disk.sdb1.out‚0* proc.memory.percent‚18.830537796020508 network.sent‚ 9.500551e+06 disk.sdb2.in‚9.4375! disk.sdb2.out‚562.93310546875 disk.sdb.out‚562.93310546875) disk./.usagePercent‚83.22514293364588% disk./.usageGB‚2976.5342330932617 disk.sdb1.in‚0 disk.sda.out‚562.93310546875 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 542.265625# memory_percent‚92.6609754562378 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚ 61326.4453125 disk.sda.in‚ 57.765625# disk.nvme1n1.out‚29692.35546875 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 cpu‚25.75685785932975 network.recv‚ 1.601192e+06 disk.rbd0.out‚ 1.404296875 disk.sda1.in‚0" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17 disk.rbd2.in‚0„•Jò2ª- _wandbruntime‚4860  _runtime‚4860Nù¹m·«öM H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 175337528 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4779865056768 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 175337528 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚353 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚96504246 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚513155631815168 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚71756804 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚502 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚518334370583040 ;5DeviceStatn{EsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 _runtime‚4860.275580491 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4779081566720 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚71757309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚602141676457472 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚22686388 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚505 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚78833280 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚587161336417856 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4763048998517 % _timestamp‚1.7884832081636856e+09 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚591924368377013 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚78833282 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4779081566720 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5178713864192 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚78833282 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 175314228 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚597361794361344XÔ§7'¬ûM XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 175314228 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚597361794361344 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 175337528 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4779865056768 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 175337528 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚353 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚96504246 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚513155631815168 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚71756804 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚502 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚518334370583040 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 _runtime‚4860.275580491 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4779081566720 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚71757309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚602141676457472 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚22686388 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚505 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚78833280 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚587161336417856 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4763048998517 % _timestamp‚1.7884832081636856e+09 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚591924368377013 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚78833282 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4779081566720 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5178713864192 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚78833282áT è2­- _wandbruntime‚4860  _runtime‚4860ÅKT[®Õ 1loss/SRqqt1/detection_loss‚0.8734510586326641 % _timestamp‚1.7884832081669202e+09 0loss/FRt1/assignment_loss‚1.3119806483083842 2loss/SRqqt2/assignment_loss‚1.0173653107309757 2loss/SRqqt3/assignment_loss‚1.3298870742520583 1loss/FBt1/assignment_loss‚0.08459038531577107 trainer/global_step‚4349 /loss/FRt3/assignment_loss‚3.119191636057461 /loss/FRt1/detection_loss‚1.6440884797092603 /loss/FBt2/detection_loss‚1.4620266479129593 0loss/FRt2/assignment_loss‚1.9946168833803908 2loss/SRqqt4/assignment_loss‚1.5934597641896846 .loss/FBt3/detection_loss‚2.423546216554112 epoch‚7 _step‚354 /loss/FBt2/assignment_loss‚0.183580285363675 1loss/FBt4/assignment_loss‚0.24961449840753558 /loss/FRt2/detection_loss‚1.9986477308671609 /loss/FRt4/detection_loss‚2.1008071692679855 0loss/SRqqt3/detection_loss‚2.505002167608057 /loss/FBt1/detection_loss‚0.6154901557912429 %loss/total_loss‚37.95716035843017 _runtime‚4860.277062527 0loss/FBt3/assignment_loss‚0.2680033048790291 /loss/FRt3/detection_loss‚2.9961947401364646 1loss/SRqqt2/detection_loss‚1.4283950657749822 0loss/SRqqt4/detection_loss‚2.385715383647093 0loss/FRt4/assignment_loss‚3.1129425097914303 2loss/SRqqt1/assignment_loss‚0.9503802149105938 .loss/FBt4/detection_loss‚2.308183026941199fT¯`¯Ú 0loss/FRt1/assignment_loss‚1.3119806483083842 2loss/SRqqt2/assignment_loss‚1.0173653107309757 2loss/SRqqt3/assignment_loss‚1.3298870742520583 1loss/FBt1/assignment_loss‚0.08459038531577107 trainer/global_step‚4349 /loss/FRt3/assignment_loss‚3.119191636057461 /loss/FRt1/detection_loss‚1.6440884797092603 /loss/FBt2/detection_loss‚1.4620266479129593 0loss/FRt2/assignment_loss‚1.9946168833803908 2loss/SRqqt4/assignment_loss‚1.5934597641896846 .loss/FBt3/detection_loss‚2.423546216554112 epoch‚7 _step‚354 /loss/FBt2/assignment_loss‚0.183580285363675 1loss/FBt4/assignment_loss‚0.24961449840753558 /loss/FRt2/detection_loss‚1.9986477308671609 /loss/FRt4/detection_loss‚2.1008071692679855 0loss/SRqqt3/detection_loss‚2.505002167608057 /loss/FBt1/detection_loss‚0.6154901557912429 %loss/total_loss‚37.95716035843017 _runtime‚4860.277062527 0loss/FBt3/assignment_loss‚0.2680033048790291 /loss/FRt3/detection_loss‚2.9961947401364646 1loss/SRqqt2/detection_loss‚1.4283950657749822 0loss/SRqqt4/detection_loss‚2.385715383647093 0loss/FRt4/assignment_loss‚3.1129425097914303 2loss/SRqqt1/assignment_loss‚0.9503802149105938 .loss/FBt4/detection_loss‚2.308183026941199 1loss/SRqqt1/detection_loss‚0.8734510586326641 % _timestamp‚1.7884832081669202e+09â÷Âk°‚(:à –­èԆ뢭 proc.cpu.threads‚17% disk./.usageGB‚2976.4899864196777 disk.sdb2.in‚9.4375! disk.sdb2.out‚565.00439453125 disk.sda2.in‚ 57.765625! disk.sda2.out‚565.00439453125 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 544.26953125 network.recv‚ 1.605585e+06 disk.sdb.in‚9.4375 disk.rbd0.in‚0 disk.rbd0.out‚ 1.404296875 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 1.341796875 disk.sda1.out‚0 disk.sdb.out‚565.00439453125 disk.dm-0.out‚ 61513.9609375 disk.rbd2.in‚0 disk.sda1.in‚0) proc.memory.availableMB‚ 1202.48828125* proc.memory.percent‚18.830537796020508 disk.nvme1n1.in‚ 32.45703125 disk.md0.out‚ 544.26953125 disk.sda.in‚ 57.765625 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚31634.17578125 network.sent‚ 9.57502e+06# disk.nvme1n1.out‚29879.78515625 disk.sdb1.in‚0 disk.sda.out‚565.00439453125$ memory_percent‚92.66059398651123) disk./.usagePercent‚83.22390577813381 disk.sdb1.out‚0" proc.memory.rssMB‚ 3085.1953125 cpu‚25.75640874492024ïƒÝŸ±‚(:” –­èԱɲ¬ gpu.0.gpu‚85.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚234.543' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚58.635749999999994 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0SWv”²‚(:‰ ¥­èÔôˈ« gpu.0.gpu‚39.0 gpu.0.memory‚7, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚230.097' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚57.52425 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0úd˜ri³‚(:Þ ¥­èÔ£•Á«" proc.memory.rssMB‚ 3085.1953125 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚566.4873046875 disk.md0.in‚ 67.203125$ memory_percent‚92.66064167022705 disk.sda2.out‚566.4873046875 disk.sdb1.out‚0 disk.sda.out‚566.4873046875 disk.sda1.in‚0 disk.sdb.in‚9.4375 network.recv‚ 1.611524e+06 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚61727.04296875 disk.sda1.out‚0" disk.nvme0n1.out‚ 31634.4453125 disk.sdb2.out‚566.4873046875 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 545.69921875 disk.rbd0.out‚ 1.404296875 disk.sdb1.in‚0 disk.sdb2.in‚9.4375 disk.md0.out‚ 545.69921875* proc.memory.percent‚18.830537796020508 cpu‚25.756154782357704) disk./.usagePercent‚83.23975915966518 disk.nvme0n1.in‚ 220.8671875) proc.memory.availableMB‚ 1202.48046875 proc.cpu.threads‚17 disk.sda2.in‚ 57.765625 network.sent‚ 9.651882e+06 disk.rbd2.in‚0 disk.sda.in‚ 57.765625# disk.nvme1n1.out‚30092.59765625% disk./.usageGB‚2977.0569801330566 disk.rbd2.out‚ 1.341796875ñߪџ´‚(:” ´­èÔœáÁ© gpu.0.gpu‚79.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0{ªqïkµ‚(:à ´­èÔ¿¤Ã« network.sent‚ 9.659867e+06 disk.sdb.in‚9.4375 disk.md0.in‚ 67.203125 disk.dm-0.in‚ 253.32421875 disk.nvme0n1.in‚ 220.8671875" disk.nvme1n1.out‚ 30264.2890625$ memory_percent‚92.66073703765869 network.recv‚ 1.615045e+06# disk.nvme0n1.out‚31634.58203125! disk.sdb2.out‚568.15576171875! disk.sda2.out‚568.15576171875" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17# disk./.usageGB‚2977.12158203125 disk.sda.out‚568.15576171875 disk.sda1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚568.15576171875 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 1.404296875) proc.memory.availableMB‚ 1202.46484375 disk.sdb1.out‚0 disk.sda2.in‚ 57.765625 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.rbd2.out‚ 1.341796875* proc.memory.percent‚18.830537796020508) disk./.usagePercent‚83.24156545577667 disk.sda.in‚ 57.765625 disk.sda1.in‚0 disk.md0.out‚ 547.30859375 disk.sdb1.in‚0 disk.sdb2.in‚9.4375 disk.md0p1.out‚ 547.30859375 disk.dm-0.out‚61898.87109375 cpu‚25.755781704372883 ›m2¶- _wandbruntime‚4912  _runtime‚4912L†ÝîÈ·Â ' lr-AdamW/pg2‚0.00024940986185248713 trainer/global_step‚4399 $ _timestamp‚1.788483259976976e+09 _runtime‚4912.090211574 _step‚355 ' lr-AdamW/pg1‚0.00024940986185248713\‘ÀØÍ¸Ç _step‚355 ' lr-AdamW/pg1‚0.00024940986185248713 ' lr-AdamW/pg2‚0.00024940986185248713 trainer/global_step‚4399 $ _timestamp‚1.788483259976976e+09 _runtime‚4912.090211574ãE7à42¹- _wandbruntime‚4912  _runtime‚4912„üFãS!ºëO UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚518748703059968 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4815932173383 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4832143473664 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 177258714 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5235028109824 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚22929703 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚608697968640000 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚72527324 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚523983893508608 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚97547012 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚593563179229456 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚97570284 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚79688430 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚97570284 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚72527864 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚598378329920955 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚608698769156096 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚603866608643072 _runtime‚4912.090359174 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚603866608643072 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚593563196268816 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚49598161 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚603866625682432 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0×DZö'»ðO NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 trainer/global_step‚4399 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚608698769156096 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚603866608643072 _runtime‚4912.090359174 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚603866608643072 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚593563196268816 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚49598161 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚603866625682432 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚518748703059968 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4815932173383 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4832143473664 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 177258714 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5235028109824 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚22929703 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚608697968640000 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚72527324 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚523983893508608 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚97547012 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚593563179229456 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚97570284 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚79688430 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚97570284 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚72527864 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚598378329920955 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 J8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5236337543168 _runtime‚4912.946764096 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚603999359954944 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚503 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚79705880 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4832426335744 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚603999376994304 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚97591998 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4833209825792 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚72543579 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚593693846469856 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚79705882 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 177297880 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚72543076 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚518862821959168 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 177297880 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5236181509120 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4832426335744 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚49608918 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0›6…0'¾ûM EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4832426335744 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚49608918 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚97568700 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚598510841388773 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚593693829430496 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4816994918917 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚97591998 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4833209825792 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5236337543168 _runtime‚4912.946764096 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚603999359954944 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚503 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚79705880 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4832426335744 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚603999376994304 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚97591998 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4833209825792 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚72543579 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚593693846469856 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚79705882 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 177297880 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚72543076 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚518862821959168 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 177297880 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5236181509120å­ÙÒ¡2¿- _wandbruntime‚4912  _runtime‚4912Tåg-ÚÀ× 1loss/FBt3/assignment_loss‚0.25387842301227337 .loss/FBt4/detection_loss‚2.538336600576128 _runtime‚ 4912.94774277 0loss/FRt2/assignment_loss‚1.7642298747445935 0loss/FBt1/assignment_loss‚0.0781339026107793 1loss/SRqqt4/detection_loss‚2.6107302644036032 % _timestamp‚1.7884832608377278e+09 0loss/FRt1/assignment_loss‚1.4129008939585734 2loss/SRqqt3/assignment_loss‚1.4569674742929006 2loss/FBt2/assignment_loss‚0.052018775294649426 0loss/SRqqt2/detection_loss‚1.225318785406799 1loss/FBt4/assignment_loss‚0.16869473473194657 /loss/FRt2/detection_loss‚1.7949498615044857 /loss/FBt3/detection_loss‚2.5753735271947726 %loss/total_loss‚37.70756994626544 /loss/FRt4/a eƒssignment_loss‚3.178617824912071 2loss/SRqqt1/assignment_loss‚1.0149151113632104 1loss/SRqqt1/detection_loss‚1.0970975359964927 /loss/FBt1/detection_loss‚0.5861584273391757 trainer/global_step‚4399 _step‚358 /loss/FRt3/assignment_loss‚2.951326421590952 2loss/SRqqt2/assignment_loss‚1.1460773216172953 /loss/FRt4/detection_loss‚1.9157460910093504 1loss/SRqqt3/detection_loss‚2.3874301703299508 /loss/FBt2/detection_loss‚1.2536277547478676 epoch‚7 2loss/SRqqt4/assignment_loss‚1.7322797019373286 .loss/FRt1/detection_loss‚1.697956244739675 /loss/FRt3/detection_loss‚2.8148042229505688–ïÚbÁÜ 2loss/SRqqt3/assignment_loss‚1.4569674742929006 2loss/FBt2/assignment_loss‚0.052018775294649426 0loss/SRqqt2/detection_loss‚1.225318785406799 1loss/FBt4/assignment_loss‚0.16869473473194657 /loss/FRt2/detection_loss‚1.7949498615044857 /loss/FBt3/detection_loss‚2.5753735271947726 %loss/total_loss‚37.70756994626544 /loss/FRt4/assignment_loss‚3.178617824912071 2loss/SRqqt1/assignment_loss‚1.0149151113632104 1loss/SRqqt1/detection_loss‚1.0970975359964927 /loss/FBt1/detection_loss‚0.5861584273391757 trainer/global_step‚4399 _step‚358 /loss/FRt3/assignment_loss‚2.951326421590952 2loss/SRqqt2/assignment_loss‚1.1460773216172953 /loss/FRt4/detection_loss‚1.9157460910093504 1loss/SRqqt3/detection_loss‚2.3874301703299508 /loss/FBt2/detection_loss‚1.2536277547478676 epoch‚7 2loss/SRqqt4/assignment_loss‚1.7322797019373286 .loss/FRt1/detection_loss‚1.697956244739675 /loss/FRt3/detection_loss‚2.8148042229505688 1loss/FBt3/assignment_loss‚0.25387842301227337 .loss/FBt4/detection_loss‚2.538336600576128 _runtime‚ 4912.94774277 0loss/FRt2/assignment_loss‚1.7642298747445935 0loss/FBt1/assignment_loss‚0.0781339026107793 1loss/SRqqt4/detection_loss‚2.6107302644036032 % _timestamp‚1.7884832608377278e+09 0loss/FRt1/assignment_loss‚1.4129008939585734æƒr„.”‚(:‰ íèÔ‰ÐÌ© gpu.0.gpu‚66.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚208.378' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.0945 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0«1­gÂ(:Ü íèÔ¤ù°« disk.rbd0.in‚0$ memory_percent‚92.66235828399658 network.sent‚ 9.676917e+06% disk./.usageGB‚2977.3118438720703 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.4375" proc.memory.rssMB‚ 3085.1953125* proc.memory.percent‚18.830537796020508 proc.cpu.threads‚17) disk./.usagePercent‚83.24688525647676 disk.sda.in‚ 57.765625 disk.md0.in‚ 67.203125 disk.rbd2.out‚ 1.341796875 disk.sdb1.in‚0 network.recv‚ 1.619575e+06 disk.sda.out‚570.25048828125 disk.sda2.in‚ 57.765625 disk.sda1.in‚0 disk.md0p1.out‚ 549.3359375 cpu‚25.755412646790806 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875! disk.sdb2.out‚570.25048828125 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.sdb1.out‚0! disk.sda2.out‚570.25048828125 disk.rbd0.out‚ 1.404296875 disk.nvme1n1.out‚ 30510.53125) proc.memory.availableMB‚ 1202.19921875 disk.dm-0.out‚ 62145.3046875" disk.nvme0n1.out‚ 31634.7734375 disk.sdb.out‚570.25048828125 disk.sdb2.in‚9.4375 disk.md0.out‚ 549.3359375 disk.md0p1.in‚ 67.203125Ô‰:ؔĂ(:‰ Ò­èÔª—‹ª gpu.0.gpu‚53.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚212.445' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.11125 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Gô–gÅ‚(:Ü Ò­èÔ§òË« network.recv‚ 1.623909e+06 disk.sdb1.in‚0 disk.sda1.in‚0* proc.memory.percent‚18.830537796020508 disk.sda.in‚ 57.765625 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375! disk.sdb2.out‚571.94287109375! disk.sda2.out‚571.94287109375 disk.sda.out‚571.94287109375 disk.sda1.out‚0 disk.md0.out‚ 550.9609375) proc.memory.availableMB‚ 1202.23828125 network.sent‚ 9.749217e+06% disk./.usageGB‚2977.3113288879395 disk.sdb2.in‚9.4375 disk.md0p1.out‚ 550.9609375 disk.rbd2.out‚ 1.341796875 proc.cpu.threads‚17 disk.sdb1.out‚0 disk.md0p1.in‚ 67.203125 disk.rbd2.in‚0 cpu‚25.754991874360503 disk.nvme0n1.out‚ 31634.875 disk.sdb.out‚571.94287109375" proc.memory.rssMB‚ 3085.1953125) disk./.usagePercent‚83.24687085730493 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.dm-0.out‚62488.50390625$ memory_percent‚92.66211986541748 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚30853.62890625 disk.sda2.in‚ 57.765625 disk.rbd0.out‚ 1.404296875 disk.dm-0.in‚ 253.32421875 J•Æ‚(:Š á­èÔú‡ý« gpu.0.gpu‚38.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0núÆÉiÇ‚(:Þ á­èÔ󔊭 disk.rbd0.out‚ 1.404296875" proc.memory.rssMB‚ 3085.1953125 network.recv‚ 1.628953e+06 disk.sdb.in‚9.4375! disk.sda2.out‚573.68310546875 disk.sdb1.in‚0 disk.sda1.in‚0$ memory_percent‚92.66211986541748 network.sent‚ 9.755967e+06 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.in‚0# disk.nvme1n1.out‚30980.81640625 disk.sda.out‚573.68310546875 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 552.6328125 disk.rbd2.out‚ 1.341796875 disk.sda.in‚ 57.765625* proc.memory.percent‚18.830537796020508 cpu‚25.754659957488514 disk.md0.in‚ 67.203125 disk.md0.out‚ 552.6328125 disk.rbd2.in‚0 disk.sda1.out‚0) proc.memory.availableMB‚ 1202.23828125 proc.cpu.threads‚17% disk./.usageGB‚2977.3113861083984 disk.sdb.out‚573.68310546875 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.8671875! disk.sdb2.out‚573.68310546875 disk.dm-0.out‚ 62615.90625) disk./.usagePercent‚83.24687245721292# disk.nvme0n1.out‚31635.08984375¾åQ"“È‚(:ˆ ð­èÔâуª gpu.0.gpu‚49.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚207.274' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.8185 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ô1ôhÉ‚(:Ý ð­èÔ½ø—­' proc.memory.availableMB‚ 1202.234375 disk.nvme1n1.in‚ 32.45703125 network.recv‚ 1.63302e+06! disk.sda2.out‚575.04443359375 disk.dm-0.out‚63004.16796875 disk.sda.in‚ 57.765625 disk.sdb2.in‚9.4375$ memory_percent‚92.66214370727539* proc.memory.percent‚18.830537796020508 network.sent‚ 9.763454e+06% disk./.usageGB‚2977.3114128112793 disk.sda1.in‚0 proc.cpu.threads‚17 disk.sdb.in‚9.4375) disk./.usagePercent‚83.24687320383663 disk.md0.in‚ 67.203125# disk.nvme1n1.out‚31369.00390625 disk.md0p1.out‚ 553.9296875 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0" disk.nvme0n1.out‚ 31635.1640625! disk.sdb2.out‚575.04443359375" proc.memory.rssMB‚ 3085.1953125 disk.md0.out‚ 553.9296875 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875 cpu‚25.754194924808175 disk.rbd0.out‚ 1.404296875 disk.sda.out‚575.04443359375 disk.sda2.in‚ 57.765625 disk.md0p1.in‚ 67.203125 disk.rbd2.out‚ 1.341796875 disk.sdb.out‚575.04443359375oz"Z2Ê- _wandbruntime‚4965  _runtime‚4965ÏpŸÈË trainer/global_step‚4449 % _timestamp‚1.7884833136104422e+09 _runtime‚ 4965.72074217 _step‚359 ' lr-AdamW/pg1‚0.00023551533943081318 ' lr-AdamW/pg2‚0.00023551533943081318œ~ñ|ÍÌÇ trainer/global_step‚4449 % _timestamp‚1.7884833136104422e+09 _runtime‚ 4965.72074217 _step‚359 ' lr-AdamW/pg1‚0.00023551533943081318 ' lr-AdamW/pg2‚0.00023551533943081318ç”»H@2Í- _wandbruntime‚4965  _runtime‚4965ƒï&ò'ÎìO UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚615388879002624 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚610504191276032 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5292805378048 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚610504191276032 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚511 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚98634764 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4869096611691 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚98658036 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚23178951 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4868315129807 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚23178440 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚524455868300288 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚615388879002624 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 179195792 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚529748854629376 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884833136115208e+09 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚615389679518720 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚615389679518720 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚604964004411263 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚50136161 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 179219066 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚610504174236672 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚524455893203968 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚600095706320816 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚73315112 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚529748673678336 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚4965.721934286 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚514 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚604964802932507 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚600095689281456 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚80561030 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5292961425408 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4884704765952 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚98634764 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚80561030 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚80561028 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4885488242688 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚98658036 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4885488242688 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752ëY"C÷'ÏñO VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚615389679518720 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚615389679518720 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚604964004411263 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚50136161 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 179219066 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚610504174236672 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚524455893203968 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚600095706320816 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚73315112 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚529748673678336 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _runtime‚4965.721934286 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚514 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚604964802932507 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚600095689281456 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚80561030 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5292961425408 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4884704765952 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚98634764 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚80561030 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚80561028 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4885488242688 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚98658036 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4885488242688 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚615388879002624 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚610504191276032 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5292805378048 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚610504191276032 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚511 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚98634764 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4869096611691 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚98658036 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚23178951 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4868315129807 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚23178440 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚524455868300288 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚615388879002624 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 179195792 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚529748854629376 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884833136115208e+09è2Ð- _wandbruntime‚4966  _runtime‚4966û,“)š ÑõM B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚529863967901184 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 179258232 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 $ _timestamp‚1.788483314461536e+09 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚98679750 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚98656452 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚80578482 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚80578482 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4886554594816 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚80578480 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚50146921 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚98656452 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚610636925548544 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚605095717357629 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚600226339482496 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚73330308 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4870159357225 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚615523497182720 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚529864150936064 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚23183898 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23183390 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5293955798016 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 trainer/global_step‚4449@ÓÑ'ÒúM E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4869377875133 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 $ _timestamp‚1.788483314461536e+09 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚98679750 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚98656452 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚80578482 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚80578482 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4886554594816 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚80578480 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚50146921 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚98656452 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚610636925548544 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚605095717357629 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚600226339482496 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚73330308 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4870159357225 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚615523497182720 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚529864150936064 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚23183898 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23183390 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5293955798016 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 trainer/global_step‚4449 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚529863967901184 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 179258232 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 PDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4938833011712 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚23428780 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5350799654912 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚81433628 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚622080589881344 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚617141739830272 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚606628216372816 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 $ _timestamp‚1.788483366910364e+09 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 181179418 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚611549678901571 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4922261049999 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚99745788 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚606628199333456 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4938833011712 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚622080589881344 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚535513702051840 trainer/global_step‚4499 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚74102941 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚81433630 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚74102423 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚50674158 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚530163083347968 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚611550477422815 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚518 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 _runtime‚5019.021161174 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚622079789365248 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 2ªiAc­5797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚99745788 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4938049534976 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚535513883002880 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚530163058444288 _step‚364 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚99722516 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚622079789365248 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5350643607552 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚81433628 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 181156144•w)îö'áðO WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚81433628 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚622080589881344 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚617141739830272 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚606628216372816 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 $ _timestamp‚1.788483366910364e+09 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 181179418 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚611549678901571 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 4922261049999 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚99745788 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚606628199333456 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4938833011712 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚622080589881344 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚535513702051840 trainer/global_step‚4499 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚74102941 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚81433630 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚74102423 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚50674158 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚530163083347968 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚611550477422815 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚518 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 _runtime‚5019.021161174 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚622079789365248 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 PCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚99745788 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4938049534976 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚535513883002880 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚530163058444288 _step‚364 L?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚99722516 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚622079789365248 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5350643607552 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚81433628 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 181156144 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚617141739830272 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4938049534976 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚617141756869632 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4938833011712 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚23428780 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5350799654912 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352ìk<˜o2â- _wandbruntime‚5019  _runtime‚5019¥æï!û&ãõM L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5351959384064 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4939115873792 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚99767502 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚622213607015936 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚99744204 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚617274508181504 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚50684918 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚535629186534912 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚50684921 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚528 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 181218584 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23433137 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚535629011888640 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚622214407545344 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚611682190369389 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚23433665 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚622214407545344 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 181218584 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚611681391847937 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚606758849534496 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚74118055 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚99744204 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚530277202247168 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚617274491142144 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚99767502 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚606758866573856 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4923323795533 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 $ _timestamp‚1.788483367878121e+09 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚81451082 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚74118586 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 181195284 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 149742592 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚81451080 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚81451080 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚531 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚530277227150848 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5351809641472 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4922542313441 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 181195284 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚617274491142144 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4939899363840 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 trainer/global_step‚4499 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚81451082 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚365tøCY'äúM RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚617274508181504 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4939899363840 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 _runtime‚5019.989406272 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚622213607015936 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 J=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚99744204 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚617274508181504 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚50684918 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚535629186534912 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚50684921 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚528 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 181218584 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23433137 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚535629011888640 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚622214407545344 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚611682190369389 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚23433665 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚622214407545344 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 181218584 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚611681391847937 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚606758849534496 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚74118055 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 174646272 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 NADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚99744204 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚530277202247168 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚617274491142144 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚99767502 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚606758866573856 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4923323795533 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 $ _timestamp‚1.788483367878121e+09 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚81451082 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚74118586 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 181195284 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 149742592 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚81451080 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚81451080 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚531 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚530277227150848 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5351809641472 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4922542313441 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 181195284 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚617274491142144 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4939899363840 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 trainer/global_step‚4499 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚81451082 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚365 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5351959384064 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4939115873792 REDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚99767502 PDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚628770699727872 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5408409341440 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5408569583104 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚628771500243968 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 100833540 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚623779322463232 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚82306230 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚623779322463232 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4992177780736 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4992177780736 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚623779305423872 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚618136151913123 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚541278843075072 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚23677663 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚618135353391879 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _runtime‚ 5067.18137688 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 100833540 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚74889306 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4991394304000 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4991394304000 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚518 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚51212161 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4974644006423 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 183116496 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚51212158 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚541278657929728 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚23677148 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 % _timestamp‚1.7884834150709388e+09 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚628770699727872 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5408409341440 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5408569583104 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚628771500243968 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 100833540 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚623779322463232 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚82306230 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚623779322463232 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 4992177780736 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 4992177780736 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚623779305423872 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚618136151913123 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚541278843075072 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚23677663 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚618135353391879 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _runtime‚ 5067.18137688 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 100833540 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚74889306 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 4991394304000 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 4991394304000 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚518 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚51212161 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 4974644006423 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 183116496 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚51212158 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚515 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚541278657929728 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚23677148 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 % _timestamp‚1.7884834150709388e+09 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚623912073775104 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚82323682 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚541394135058432 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 183178936 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4976488233841 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚82323680 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚628904517378560 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4992460642816 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚82323680 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5409717763584 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚623912056735744 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4993244132864 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 183178936 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚535984392391168 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚74905615 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 100831956 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 % _timestamp‚1.7884834159213219e+09 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4993244132864 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4992460642816 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚82323682 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚613291359586496 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚618267864859697 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚535984417294848 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5409559632384 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚623912073775104 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚51222921 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚623912056735744 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚51222918 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 _step‚369 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 100855254 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚541393952023552 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 183155636 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23682186 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 100855254 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚74905104 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚23682694 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚613291376625856 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0%×É#'öÿM E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚74905615 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 100831956 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 % _timestamp‚1.7884834159213219e+09 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 4993244132864 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 4992460642816 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚82323682 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚613291359586496 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚618267864859697 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚535984417294848 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5409559632384 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚623912073775104 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚51222921 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚623912056735744 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚51222918 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 _step‚369 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 100855254 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚541393952023552 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 183155636 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23682186 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 100855254 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚74905104 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚23682694 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚613291376625856 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 4975706751749 _runtime‚5068.032173993 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚628905317907968 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚628905317907968 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚623912073775104 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚82323682 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚541394135058432 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 183178936 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 4976488233841 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚82323680 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚628904517378560 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 4992460642816 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚82323680 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5409717763584 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚623912056735744 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 4993244132864 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 183178936 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚535984392391168 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064ñÅbJ2÷- _wandbruntime‚5068  _runtime‚5068Å…n#ZøÔ epoch‚7 1loss/FBt1/assignment_loss‚0.11093101961553342 1loss/SRqqt1/detection_loss‚0.9200973210870537 1loss/FBt4/assignment_loss‚0.19739296678034618 .loss/FRt3/detection_loss‚2.809313178062439 /loss/FRt4/detection_loss‚2.2072276142517744 .loss/SRqqt4/detection_loss‚2.2261985710689 /loss/FRt2/assignment_loss‚1.656399012220149 2loss/SRqqt2/assignment_loss‚1.0657898031227977 1loss/FBt3/assignment_loss‚0.20184478902090633 /loss/FBt2/detection_loss‚1.4858956328696675 /loss/FBt4/detection_loss‚2.2228049154465017 % _timestamp‚1.7884834159231176e+09 _runtime‚5068.033191028 0loss/FRt4/assignment_loss‚2.8268379964326558 2loss/SRqqt4/assignment_loss‚1.4501192442599744 1loss/SRqqt2/detection_loss‚1.1564236481984456 0loss/SRqqt3/detection_loss‚2.377824518829584 trainer/global_step‚4549 %loss/total_loss‚36.36905006895219 2loss/SRqqt1/assignment_loss‚0.8307324055607168 /loss/FBt1/detection_loss‚0.5913765124362502 0loss/FRt1/assignment_loss‚1.5479696883095635 /loss/FRt2/detection_loss‚1.8649497436435551 /loss/FBt3/detection_loss‚2.2250030863285066 _step‚370 /loss/FRt3/assignment_loss‚2.723114547133446 2loss/SRqqt3/assignment_loss‚1.8700096978573129 0loss/FBt2/assignment_loss‚0.0639689648140002 .loss/FRt1/detection_loss‚1.736825191602111Æ`o_ùÙ 0loss/FRt1/assignment_loss‚1.5479696883095635 /loss/FRt2/detection_loss‚1.8649497436435551 /loss/FBt3/detection_loss‚2.2250030863285066 _step‚370 /loss/FRt3/assignment_loss‚2.723114547133446 2loss/SRqqt3/assignment_loss‚1.8700096978573129 0loss/FBt2/assignment_loss‚0.0639689648140002 .loss/FRt1/detection_loss‚1.736825191602111 epoch‚7 1loss/FBt1/assignment_loss‚0.11093101961553342 1loss/SRqqt1/detection_loss‚0.9200973210870537 1loss/FBt4/assignment_loss‚0.19739296678034618 .loss/FRt3/detection_loss‚2.809313178062439 /loss/FRt4/detection_loss‚2.2072276142517744 .loss/SRqqt4/detection_loss‚2.2261985710689 /loss/FRt2/assignment_loss‚1.656399012220149 2loss/SRqqt2/assignment_loss‚1.0657898031227977 1loss/FBt3/assignment_loss‚0.20184478902090633 /loss/FBt2/detection_loss‚1.4858956328696675 /loss/FBt4/detection_loss‚2.2228049154465017 % _timestamp‚1.7884834159231176e+09 _runtime‚5068.033191028 0loss/FRt4/assignment_loss‚2.8268379964326558 2loss/SRqqt4/assignment_loss‚1.4501192442599744 1loss/SRqqt2/detection_loss‚1.1564236481984456 0loss/SRqqt3/detection_loss‚2.377824518829584 trainer/global_step‚4549 %loss/total_loss‚36.36905006895219 2loss/SRqqt1/assignment_loss‚0.8307324055607168 /loss/FBt1/detection_loss‚0.5913765124362502òìiCtjú‚(:ß Ù®èÔ”“‘« disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚32088.05859375 proc.cpu.threads‚17 network.sent‚ 9.964295e+06% disk./.usageGB‚2976.2497596740723 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0 disk.sda1.in‚0# disk.nvme1n1.out‚32042.87109375! disk.sdb2.out‚588.63720703125) disk./.usagePercent‚83.21718893778397 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 567.0390625 disk.sda.out‚588.63720703125 disk.sdb2.in‚9.4375" proc.memory.rssMB‚ 3085.1953125 disk.md0p1.in‚ 67.203125 disk.nvme1n1.in‚ 32.45703125 cpu‚25.751976135358458 disk.rbd2.out‚ 1.341796875 disk.sdb1.out‚0 disk.sda.in‚ 57.765625 disk.sdb.in‚9.4375 disk.sda2.in‚ 57.765625$ memory_percent‚92.66445636749268 disk.sdb1.in‚0! disk.sda2.out‚588.63720703125 disk.md0.out‚ 567.0390625 disk.sdb.out‚588.63720703125) proc.memory.availableMB‚ 1201.85546875* proc.memory.percent‚18.830537796020508 network.recv‚ 1.66453e+06 disk.rbd0.out‚ 1.404296875 disk.dm-0.out‚ 64130.9296875UT•û“û‚(:ˆ Ù®èÔúÀÆ« gpu.0.gpu‚73.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚211.89' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.9725 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0r‚ƒÕü‚(:’ è®èÔìÑã© gpu.0.gpu‚21.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚218.347' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚54.58675000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0\*­ký‚(:à è®èÔ„§ùª disk.sda.in‚ 57.765625 disk.sda1.out‚0" disk.nvme1n1.out‚ 32044.3671875 disk.sdb.in‚9.4375" proc.memory.rssMB‚ 3085.1953125 network.sent‚ 1.0052187e+07 disk.md0p1.out‚ 568.44140625 disk.rbd2.out‚ 1.341796875 disk.sda.out‚590.10693359375* proc.memory.percent‚18.830537796020508 proc.cpu.threads‚17 disk.sdb1.in‚0# disk.nvme0n1.out‚32192.16015625 disk.nvme1n1.in‚ 32.45703125# memory_percent‚92.6645040512085 cpu‚25.75172814840941 disk.rbd0.in‚0 disk.sdb2.in‚9.4375 disk.sda2.in‚ 57.765625 disk.dm-0.in‚ 253.32421875 disk.md0.out‚ 568.44140625 disk.rbd0.out‚ 1.404296875) disk./.usagePercent‚83.20604429876417$ disk./.usageGB‚2975.851173400879 disk.md0.in‚ 67.203125 disk.dm-0.out‚64236.52734375 disk.sdb1.out‚0) proc.memory.availableMB‚ 1201.84765625 disk.nvme0n1.in‚ 220.8671875! disk.sdb2.out‚590.10693359375 disk.rbd2.in‚0 disk.sda1.in‚0 disk.sdb.out‚590.10693359375 network.recv‚ 1.668896e+06! disk.sda2.out‚590.10693359375 disk.md0p1.in‚ 67.203125&ì-Å“þ‚(:ˆ ÷®èÔî˜Æ« gpu.0.gpu‚84.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚226.37' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.5925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0͈,iÿ‚(:Þ ÷®èÔ€ÎÚ« disk.rbd2.in‚0 proc.cpu.threads‚17 network.recv‚ 1.673442e+06 disk.sda1.in‚0 disk.sdb2.out‚591.8466796875 disk.sda2.in‚ 57.765625 disk.sda1.out‚0 disk.sdb.in‚9.4375 disk.rbd0.in‚0) proc.memory.availableMB‚ 1201.60546875 disk.sdb2.in‚9.4375 disk.dm-0.in‚ 253.32421875 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.md0.in‚ 67.203125 disk.md0.out‚ 570.10546875 disk.rbd0.out‚ 1.404296875 disk.rbd2.out‚ 1.341796875* proc.memory.percent‚18.830537796020508 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚32235.15234375 disk.nvme1n1.in‚ 32.45703125" proc.memory.rssMB‚ 3085.1953125) disk./.usagePercent‚83.20599950134067% disk./.usageGB‚2975.8495712280273 disk.sda.in‚ 57.765625 disk.sda2.out‚591.8466796875 disk.dm-0.out‚64279.79296875 network.sent‚ 1.0058612e+07$ memory_percent‚92.66598224639893 cpu‚25.751374577281354 disk.sda.out‚591.8466796875! disk.nvme1n1.out‚ 32044.640625 disk.sdb.out‚591.8466796875 disk.md0p1.in‚ 67.203125 disk.md0p1.out‚ 570.10546875>ey•€‚(:Š †¯èԔėª gpu.0.gpu‚67.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚194.865' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚48.71625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ƒ3‰Õ^‚(:Ó †¯èÔŤ¥«) disk./.usagePercent‚83.21171245276219 disk.dm-0.out‚ 64441.6953125 disk.sdb1.out‚0& proc.memory.availableMB‚ 1201.84375 disk.sda2.in‚ 57.765625 disk.rbd2.out‚ 1.341796875 disk.sda.in‚ 57.765625 disk.nvme0n1.in‚ 220.8671875 disk.sdb.in‚9.4375 disk.rbd2.in‚0" proc.memory.rssMB‚ 3085.1953125% disk./.usageGB‚2976.0538940429688 disk.sdb2.out‚593.2841796875 disk.sdb1.in‚0 network.recv‚ 1.676604e+06 disk.nvme1n1.in‚ 32.45703125 disk.nvme1n1.out‚32044.75 disk.md0.out‚ 571.46484375 disk.md0p1.out‚ 571.46484375 disk.sda1.in‚0 disk.sdb.out‚593.2841796875 disk.sda2.out‚593.2841796875 disk.md0.in‚ 67.203125 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 1.404296875 disk.sda1.out‚0* proc.memory.percent‚18.830537796020508 cpu‚25.75122922512906 disk.sdb2.in‚9.4375 disk.rbd0.in‚0 disk.dm-0.in‚ 253.32421875 disk.sda.out‚593.2841796875" disk.nvme0n1.out‚ 32396.9453125# memory_percent‚92.6645278930664 proc.cpu.threads‚17 network.sent‚ 1.0061506e+07įâ62‚- _wandbruntime‚5116  _runtime‚5116“þÛÛɃà trainer/global_step‚4599 % _timestamp‚1.7884834648534627e+09 _runtime‚5116.963838931 _step‚371 ' lr-AdamW/pg1‚0.00019569337146516964 ' lr-AdamW/pg2‚0.00019569337146516964‰„ãÎ„È ' lr-AdamW/pg1‚0.00019569337146516964 ' lr-AdamW/pg2‚0.00019569337146516964 trainer/global_step‚4599 % _timestamp‚1.7884834648534627e+09 _runtime‚5116.963838931 _step‚371ó?nˆ,2…- _wandbruntime‚5116  _runtime‚5116‰!å_B†ðO UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚624721027882187 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚635461610090496 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 185100122 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚635462410606592 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚630416871017472 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5044739073024 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 185076848 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚630416888056832 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚619693219437456 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5027808444731 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚635461610090496 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚75678697 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 trainer/global_step‚4599 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚540 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5045522549760 UGDeviceStatsMonitor.on_train_batch_start/alr ù…´location.small_pool.allocated‚ 101921292 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5466348796416 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚630416871017472 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5044739073024 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚537 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚630416888056832 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚541577438732288 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 101898020 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚541577463635968 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚547043812432384 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚547043633578496 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0”³ò„û'‡õO YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚630416871017472 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5044739073024 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚537 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚630416888056832 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚541577438732288 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 101898020 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚541577463635968 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚547043812432384 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚547043633578496 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚624721027882187 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚635461610090496 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 185100122 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚635462410606592 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚630416871017472 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5044739073024 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 185076848 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 153950208 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚630416888056832 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚619693219437456 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5027808444731 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚635461610090496 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚75678697 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 trainer/global_step‚4599 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚540 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5045522549760 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 101921292 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5466348796416 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785ôm‘¤@2ˆ- _wandbruntime‚5117  _runtime‚5117erÒ\'‰úM D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5046588901888 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚83196280 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚83196282 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 185139288 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 185115988 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚619823886677856 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 trainer/global_step‚4599 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚630549622329344 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚630549639368704 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚635595427741184 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚529 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚541691607438848 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚541691582535168 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚547159106698752 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23933000 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚635596228270592 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 101919708 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5046588901888 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 189326336 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 164422656 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚630549639368704 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 % _timestamp‚1.7884834657920578e+09 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚75693918 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚624853539350005 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5029652672149 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚630549622329344 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5045805411840 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚526 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _runtime‚5117.903243841 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5467499259904 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 _step‚373 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 185139288 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 % _timestamp‚1.7884834657920578e+09 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚75693918 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚624853539350005 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5029652672149 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚630549622329344 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5045805411840 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚526 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _runtime‚5117.903243841 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5467499259904 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 _step‚373 FDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 185139288 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5046588901888 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚83196280 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚83196282 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 185139288 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 185115988 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚619823886677856 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 trainer/global_step‚4599 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚630549622329344 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚630549639368704 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚635595427741184 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚529 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚541691607438848 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚541691582535168 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚547159106698752 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚23933000 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚635596228270592 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352õæ= 2‹- _wandbruntime‚5117  _runtime‚5117'bi°·ŒÓ /loss/FRt1/detection_loss‚1.8095176660220373 1loss/SRqqt4/detection_loss‚2.6380043299868703 /loss/FBt4/detection_loss‚2.3482173609733583 1loss/FBt2/assignment_losFU2¢s‚0.06518880428453144 epoch‚7 % _timestamp‚1.7884834657941432e+09 .loss/FBt3/detection_loss‚2.275799040283476 %loss/total_loss‚38.61975305468658 /loss/FRt2/detection_loss‚1.8776021429494154 2loss/SRqqt1/assignment_loss‚0.9461597321375917 0loss/FBt1/assignment_loss‚0.1518991676676506 .loss/FBt2/detection_loss‚1.645636952482164 2loss/SRqqt2/assignment_loss‚1.1255122802727773 /loss/FBt3/assignment_loss‚0.128259649905517 .loss/FRt3/detection_loss‚3.071810019951241 /loss/FRt4/detection_loss‚1.9327550645947078 1loss/SRqqt1/detection_loss‚0.9821695330337836 trainer/global_step‚4599 0loss/FBt4/assignment_loss‚0.4885607065228942 1loss/SRqqt2/detection_loss‚1.1107316231076232 0loss/SRqqt3/detection_loss‚2.625860771164298 /loss/FBt1/detection_loss‚0.6228494992740734 2loss/SRqqt3/assignment_loss‚1.4163846329320222 _step‚374 0loss/FRt2/assignment_loss‚2.0759063563515654 0loss/FRt3/assignment_loss‚3.2984593218448115 0loss/FRt4/assignment_loss‚3.5130742421517005 1loss/SRqqt4/assignment_loss‚1.291880216798745 _runtime‚5117.904396166 /loss/FRt1/assignment_loss‚1.177513939993722® –^Ø 0loss/FBt4/assignment_loss‚0.4885607065228942 1loss/SRqqt2/detection_loss‚1.1107316231076232 0loss/SRqqt3/detection_loss‚2.625860771164298 /loss/FBt1/detection_loss‚0.6228494992740734 2loss/SRqqt3/assignment_loss‚1.4163846329320222 _step‚374 0loss/FRt2/assignment_loss‚2.0759063563515654 0loss/FRt3/assignment_loss‚3.2984593218448115 0loss/FRt4/assignment_loss‚3.5130742421517005 1loss/SRqqt4/assignment_loss‚1.291880216798745 _runtime‚5117.904396166 /loss/FRt1/assignment_loss‚1.177513939993722 /loss/FRt1/detection_loss‚1.8095176660220373 1loss/SRqqt4/detection_loss‚2.6380043299868703 /loss/FBt4/detection_loss‚2.3482173609733583 1loss/FBt2/assignment_loss‚0.06518880428453144 epoch‚7 % _timestamp‚1.7884834657941432e+09 .loss/FBt3/detection_loss‚2.275799040283476 %loss/total_loss‚38.61975305468658 /loss/FRt2/detection_loss‚1.8776021429494154 2loss/SRqqt1/assignment_loss‚0.9461597321375917 0loss/FBt1/assignment_loss‚0.1518991676676506 .loss/FBt2/detection_loss‚1.645636952482164 2loss/SRqqt2/assignment_loss‚1.1255122802727773 /loss/FBt3/assignment_loss‚0.128259649905517 .loss/FRt3/detection_loss‚3.071810019951241 /loss/FRt4/detection_loss‚1.9327550645947078 1loss/SRqqt1/detection_loss‚0.9821695330337836 trainer/global_step‚4599ö•(ýcŽ‚(:Ø •¯èÔ¢÷ƪ) disk./.usagePercent‚83.21346701851559 disk.sdb2.out‚595.4150390625 disk.md0p1.out‚ 573.52734375 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚ 64562.4609375 disk.rbd2.in‚0" proc.memory.rssMB‚ 3085.1953125 network.recv‚ 1.681171e+06 disk.sdb2.in‚9.4375 disk.sda.in‚ 57.765625 disk.sda.out‚595.4150390625) proc.memory.availableMB‚ 1201.73046875 disk.md0.out‚ 573.52734375 disk.nvme0n1.in‚ 220.8671875 disk.rbd0.out‚ 1.404296875 disk.sdb.in‚9.4375 cpu‚25.7499751691292 proc.cpu.threads‚17 disk.rbd2.out‚ 1.341796875 disk.sdb1.in‚0 disk.sda1.out‚0" disk.nvme0n1.out‚ 32517.3671875 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.in‚ 67.203125 disk.nvme1n1.out‚ 32045.09375# memory_percent‚92.6652193069458* proc.memory.percent‚18.830537796020508 network.sent‚ 1.0067375e+07% disk./.usageGB‚2976.1166458129883 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.sda1.in‚0 disk.sda2.in‚ 57.765625 disk.sda2.out‚595.4150390625 disk.sdb1.out‚0 disk.sdb.out‚595.4150390625c›ó•‚(:Š •¯èÔÊ«ûª gpu.0.gpu‚87.0 gpu.0.memory‚22, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚137.083' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚34.27075 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0=$¬‘‚(:† ¤¯èÔ؜ë gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚207.484' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.871 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0l¢®a‘‚(:Ö ¤¯èÔÒ«¢­ disk.sda2.in‚ 57.765625 disk.sda2.out‚ 596.912109375 disk.sda.out‚ 596.912109375 disk.sda1.out‚0 network.recv‚ 1.685615e+06 disk.sdb1.out‚0) proc.memory.availableMB‚ 1201.98046875 cpu‚25.749416456487037 disk.rbd2.in‚0" proc.memory.rssMB‚ 3085.1953125 network.sent‚ 1.0153179e+07 disk.dm-0.out‚ 64619.46875 disk.sda.in‚ 57.765625 disk.md0.in‚ 67.203125$ memory_percent‚92.66369342803955* proc.memory.percent‚18.830537796020508$ disk./.usageGB‚2976.310333251953 disk.md0p1.out‚ 574.9765625 disk.rbd0.in‚0 disk.md0.out‚ 574.9765625 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 1.341796875 disk.sdb.in‚9.4375 disk.sdb2.out‚ 596.912109375 proc.cpu.threads‚17) disk./.usagePercent‚83.21888260037353 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚ 596.912109375 disk.md0p1.in‚ 67.203125 disk.rbd0.out‚ 1.404296875 disk.sda1.in‚0 disk.sdb1.in‚0 disk.sdb2.in‚9.4375# disk.nvme0n1.out‚32574.26953125 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚32045.19921875Ó”6i’‚(:Þ ³¯èÔÖü€« disk.sda.in‚ 57.765625" disk.nvme1n1.out‚ 32045.4765625 disk.sda1.out‚0 disk.sdb.out‚598.5751953125 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚32702.45703125 disk.sdb.in‚9.4375 disk.sda2.out‚598.5751953125 disk.rbd0.in‚0 disk.rbd2.in‚0 cpu‚25.748623617595854 network.recv‚ 1.690658e+06% disk./.usageGB‚2976.4353218078613 disk.sdb1.in‚0 disk.sda.out‚598.5751953125 disk.md0p1.in‚ 67.203125 disk.dm-0.in‚ 253.32421875$ memory_percent‚92.66674518585205 proc.cpu.threads‚17 network.sent‚ 1.0159727e+07 disk.md0.out‚ 576.57421875 disk.rbd0.out‚ 1.404296875( disk./.usagePercent‚83.2223773327085 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.765625 disk.md0.in‚ 67.203125" proc.memory.rssMB‚ 3085.1953125 disk.sdb1.out‚0 disk.sdb2.out‚598.5751953125 disk.dm-0.out‚64747.93359375) proc.memory.availableMB‚ 1201.48046875* proc.memory.percent‚18.830537796020508 disk.sda1.in‚0 disk.sdb2.in‚9.4375 disk.md0p1.out‚ 576.57421875 disk.rbd2.out‚ 1.341796875ºÛÈ““‚(:ˆ ³¯èÔ˜Þ±« gpu.0.gpu‚21.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚210.886' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚52.7215 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0~àéñ2”- _wandbruntime‚5169  _runtime‚5169Ë19É•Ã ' lr-AdamW/pg1‚0.00018307685915990084 ' lr-AdamW/pg2‚0.00018307685915990084 trainer/global_step‚4649 % _timestamp‚1.7884835170238533e+09 _runtime‚5169.134243434 _step‚375Ñh×0Î–È ' lr-AdamW/pg1‚0.00018307685915990084 ' lr-AdamW/pg2‚0.00018307685915990084 trainer/global_step‚4649 % _timestamp‚1.7884835170238533e+09 _runtime‚5169.134243434 _step‚375÷ —p»2—- _wandbruntime‚5169  _runtime‚5169ƒVt ö'˜ðO N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 187060474 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5081754364923 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚637054453650432 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚631307500893739 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚637054436611072 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 % _timestamp‚1.7884835170253806e+09 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚626225746528816 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 102985772 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 103009044 _runtime‚5169.136016682 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5098867318784 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚24180320 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174659584 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚84051428 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚84051428 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5098867318784 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚538 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 102985772 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚76468481 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚642152520453120 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 _step‚376 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚642153320969216 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚642152520453120 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5524290996224 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5098083842048 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 _step‚376 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚642153320969216 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚642152520453120 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5524290996224 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5098083842048 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚637054453650432 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚631307500893739 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚637054436611072 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 % _timestamp‚1.7884835170253806e+09 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚626225746528816 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 102985772 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 103009044 _runtime‚5169.136016682 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5098867318784 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚24180320 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174659584 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚84051428 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚84051428 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5098867318784 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚538 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 102985772 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚76468481 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚642152520453120 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚76483704 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚626356379690496 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚52298918 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚552924226489344 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5082035628365 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚84068880 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚637187204962304 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚84068882 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 187099640 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚547398797582848 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 _step‚377 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5525453810176 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚84068882 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 % _timestamp‚1.7884835179691575e+09 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 103007460 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 _runtime‚5170.080299921 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 187099640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚637187187922944 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚24184786 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚642287138633216 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚642287138633216 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚84068880 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚24185307 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚637187204962304 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚631438415318861 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚642286338103808 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 103030758 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚76484228 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 103007460 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5099933670912 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 187076340 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚626356396729856 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 103030758 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚524 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚52298921 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚547398772679168 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785Ÿ¢×;'œÿM UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚521 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5525605649920 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5099150180864 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚642287138633216 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚642287138633216 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚84068880 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚24185307 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚637187204962304 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚631438415318861 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚642286338103808 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 103030758 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚76484228 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 103007460 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5099933670912 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 187076340 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚626356396729856 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 103030758 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚524 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚52298921 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚547398772679168 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚76483704 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚626356379690496 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚52298918 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚552924226489344 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5082035628365 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚84068880 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚637187204962304 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚84068882 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 187099640 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚547398797582848 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 _step‚377 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5525453810176 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚84068882 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 % _timestamp‚1.7884835179691575e+09 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 103007460 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 _runtime‚5170.080299921 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 187099640 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚637187187922944 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚24184786 B²Q¯k§‚(:à ï¯èÔÍÙðª network.sent‚ 1.0263889e+07 disk.md0.in‚ 67.203125 disk.rbd0.out‚ 1.404296875 network.recv‚ 1.707929e+06 disk.sdb.in‚9.4375( proc.memory.availableMB‚ 1201.1953125 disk.rbd0.in‚0 disk.rbd2.out‚ 1.341796875 disk.sda.out‚605.51513671875 disk.nvme0n1.out‚ 33548.90625$ memory_percent‚92.66848564147949" proc.memory.rssMB‚ 3085.1953125) disk./.usagePercent‚83.23984310150396 disk.md0p1.in‚ 67.203125 disk.sdb1.out‚0 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚32046.55859375 cpu‚25.745691769310575 proc.cpu.threads‚17 disk.sdb2.in‚9.4375 disk.sda2.in‚ 57.765625 disk.rbd2.in‚0* proc.memory.percent‚18.830537796020508% disk./.usageGB‚2977.0599822998047 disk.md0.out‚ 583.25390625 disk.dm-0.out‚65595.46484375 disk.sdb1.in‚0 disk.sda.in‚ 57.765625! disk.sdb2.out‚605.51513671875 disk.md0p1.out‚ 583.25390625 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125! disk.sda2.out‚605.51513671875 disk.dm-0.in‚ 253.32421875 disk.sdb.out‚605.51513671875ÉGš2¨- _wandbruntime‚5222  _runtime‚5222 ÖºÉ©Ã ' lr-AdamW/pg2‚0.00017080687416500085 trainer/global_step‚4699 % _timestamp‚1.7884835701327577e+09 _runtime‚5222.243148371 _step‚379 ' lr-AdamW/pg1‚0.00017080687416500085%IÒuÎªÈ ' lr-AdamW/pg1‚0.00017080687416500085 ' lr-AdamW/pg2‚0.00017080687416500085 trainer/global_step‚4699 % _timestamp‚1.7884835701327577e+09 _runtime‚5222.243148371 _step‚379û ¾ÞÐ2«- _wandbruntime‚5222  _runtime‚5222¶—*µ¬ðO ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 104073524 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚77256821 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚643692019244032 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5151428611072 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚84924028 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 trainer/global_step‚4699 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚643692002204672 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5152212087808 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚632758256580816 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚84924030 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚552991819020288 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚648844231331840 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5582209194496 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 % _timestamp‚1.7884835701343954e+09 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚52826158 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚552991843923968 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5582358950400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚648844231331840 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 189020826 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚648843430815744 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚52826161 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚637892376862803 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚84924028 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚84924030 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174659584 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5134918803231 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 _runtime‚5222.244980799 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚558574028214784 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _step‚380 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚637893175384047 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚632758239541456 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5151428611072 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 104073524 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166dn×Rû'­õO trainer/global_step‚4699 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚643692002204672 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5152212087808 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚632758256580816 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚84924030 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚552991819020288 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚648844231331840 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5582209194496 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 % _timestamp‚1.7884835701343954e+09 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚521 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚52826158 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚552991843923968 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5582358950400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚648844231331840 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 189020826 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚648843430815744 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚52826161 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚637892376862803 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚84924028 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚84924030 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174659584 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5134918803231 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 _runtime‚5222.244980799 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚558574028214784 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _step‚380 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚637893175384047 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚632758239541456 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5151428611072 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 104073524 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 104073524 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚77256821 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚643692019244032 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5151428611072 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚84924028 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785üG,2®- _wandbruntime‚5223  _runtime‚5223\#OÉ'¯úM I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚638024888330621 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚24435645 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 189059992 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚648977248466432 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚84941482 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚52836918 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 104095212 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚558689516790272 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚643824770555904 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚553105962823168 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5583381417984 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚632888889742496 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 % _timestamp‚1.7884835711105487e+09 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5135200066673 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚381 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚77272062 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5135981548765 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5152494949888 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚24435144 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚84941482 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 trainer/global_step‚4699 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 172549120 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚643824753516544 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚632888906781856 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5152494949888 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚24435645 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 189059992 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚648977248466432 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚84941482 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚52836918 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 104095212 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚558689516790272 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚643824770555904 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚553105962823168 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5583381417984 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚632888889742496 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 % _timestamp‚1.7884835711105487e+09 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5135200066673 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚381 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚77272062 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5135981548765 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5152494949888 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚24435144 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚84941482 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 trainer/global_step‚4699 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 172549120 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚643824753516544 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚632888906781856 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5152494949888 F2±- _wandbruntime‚5223  _runtime‚5223Yù^²Ø 0loss/FRt4/assignment_loss‚3.2331144416874107 2loss/SRqqt3/assignment_loss‚1.6575457097755537 1loss/FBt3/assignment_loss‚0.15876422551739325 1loss/FBt4/assignment_loss‚0.21000518960208106 /loss/FRt2/detection_loss‚1.9522980032664425 1loss/SRqqt4/detection_loss‚2.3662639958783984 /loss/FBt2/detection_loss‚1.2288462139133896 /loss/FBt3/detection_loss‚2.8061685234308245 /loss/FRt2/assignment_loss‚2.280033191982305 0loss/FRt3/assignment_loss‚2.9830906949346025 1loss/FBt2/assignment_loss‚0.10961288733119748 /loss/FRt1/detection_loss‚1.5435415906744583 .loss/FRt4/detection_loss‚2.116368098426557 epoch‚7 % _timestamp‚1.7884835711134787e+09 2loss/SRqqt1/assignment_loss‚0.8958063768778941 0loss/SRqqt2/detection_loss‚1.191565588987493 1loss/SRqqt3/detection_loss‚2.5041428298231154 _step‚382 2loss/SRqqt2/assignment_loss‚1.2165929713473933 0loss/FBt1/assignment_loss‚0.0775654439189676 /loss/FRt3/detection_loss‚2.8845698767238193 /loss/FBt1/detection_loss‚0.5238460526050579 _runtime‚5223.223878786 .loss/FBt4/detection_loss‚1.925684208671252 0loss/FRt1/assignment_loss‚1.4188779592514038 1loss/SRqqt1/detection_loss‚0.8349291497924879 %loss/total_loss‚37.37050938422405 trainer/global_step‚4699 2loss/SRqqt4/assignment_loss‚1.2512761598045472oØcc³Ý /loss/FBt3/detection_loss‚2.8061685234308245 /loss/FRt2/assignment_loss‚2.280033191982305 0loss/FRt3/assignment_loss‚2.9830906949346025 1loss/FBt2/assignment_loss‚0.10961288733119748 /loss/FRt1/detection_loss‚1.5435415906744583 .loss/FRt4/detection_loss‚2.116368098426557 epoch‚7 % _timestamp‚1.7884835711134787e+09 2loss/SRqqt1/assignment_loss‚0.8958063768778941 0loss/SRqqt2/detection_loss‚1.191565588987493 1loss/SRqqt3/detection_loss‚2.5041428298231154 _step‚382 2loss/SRqqt2/assignment_loss‚1.2165929713473933 0loss/FBt1/assignment_loss‚0.0775654439189676 /loss/FRt3/detection_loss‚2.8845698767238193 /loss/FBt1/detection_loss‚0.5238460526050579 _runtime‚5223.223878786 .loss/FBt4/detection_loss‚1.925684208671252 0loss/FRt1/assignment_loss‚1.4188779592514038 1loss/SRqqt1/detection_loss‚0.8349291497924879 %loss/total_loss‚37.37050938422405 trainer/global_step‚4699 2loss/SRqqt4/assignment_loss‚1.2512761598045472 0loss/FRt4/assignment_loss‚3.2331144416874107 2loss/SRqqt3/assignment_loss‚1.6575457097755537 1loss/FBt3/assignment_loss‚0.15876422551739325 1loss/FBt4/assignment_loss‚0.21000518960208106 /loss/FRt2/detection_loss‚1.9522980032664425 1loss/SRqqt4/detection_loss‚2.3662639958783984 /loss/FBt2/detection_loss‚1.2288462139133896þâÆQRi´‚(:Þ þ¯èÔ“‡É«! disk.nvme1n1.out‚ 32117.359375 disk.sdb.in‚9.4375 disk.md0p1.out‚ 585.1796875 disk.sdb1.in‚0* proc.memory.percent‚18.830537796020508 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.203125 disk.rbd0.in‚0 disk.sda.in‚ 57.765625 disk.sda.out‚607.51123046875" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17 disk.sdb.out‚607.51123046875 disk.rbd0.out‚ 1.404296875! disk.sdb2.out‚607.51123046875 disk.sda2.in‚ 57.765625 disk.sdb1.out‚0 disk.sda1.in‚0 disk.rbd2.out‚ 1.341796875" memory_percent‚92.665696144104) proc.memory.availableMB‚ 1201.65234375 network.sent‚ 1.0281909e+07 network.recv‚ 1.711619e+06) disk./.usagePercent‚83.24076987486757 disk.sdb2.in‚9.4375! disk.sda2.out‚607.51123046875 disk.md0p1.in‚ 67.203125 disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0% disk./.usageGB‚2977.0931282043457 disk.md0.out‚ 585.1796875 disk.dm-0.out‚65766.24609375 disk.sda1.out‚0 cpu‚25.744938085879582 disk.nvme0n1.in‚ 220.8671875# disk.nvme0n1.out‚33648.88671875Žùÿµ‚(:… þ¯èÔóʱ¬ gpu.0.gpu‚0.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚114.74' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.685 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0pìÀ)\¶‚(:Ñ °èԥ躪) proc.memory.availableMB‚ 1201.66015625# disk.nvme1n1.out‚32193.80078125 disk.sdb.out‚ 609.08984375 disk.sda2.out‚ 609.08984375 disk.rbd0.out‚ 1.404296875 disk.sda.in‚ 57.765625 proc.cpu.threads‚17 disk.md0.in‚ 67.203125 disk.md0p1.out‚ 586.703125 disk.rbd2.out‚ 1.341796875" proc.memory.rssMB‚ 3085.1953125 cpu‚25.74425444961112$ disk./.usageGB‚2977.186794281006 disk.sda1.in‚0 disk.sdb.in‚9.4375 disk.sdb2.out‚ 609.08984375 disk.rbd0.in‚0 disk.rbd2.in‚0) disk./.usagePercent‚83.24338881757328" disk.nvme0n1.out‚ 33793.1328125 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.765625 disk.dm-0.out‚65986.93359375 disk.sdb1.in‚0$ memory_percent‚92.66564846038818 disk.sda.out‚ 609.08984375 disk.sdb1.out‚0 disk.md0p1.in‚ 67.203125 disk.dm-0.in‚ 253.32421875* proc.memory.percent‚18.830537796020508 network.sent‚ 1.0356885e+07 network.recv‚ 1.717104e+06 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875 disk.sdb2.in‚9.4375 disk.md0.out‚ 586.703125Ãmžk”·‚(:‰ °èÔôŽ¨« gpu.0.gpu‚24.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚198.797' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚49.69925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0u$Á“¸‚(:ˆ œ°èÔ€ô°© gpu.0.gpu‚59.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚214.004' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.501 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 &v·r¹‚(:ç œ°èÔ´‡Îª disk.dm-0.out‚ 66304.7109375 disk.rbd2.in‚0 disk.rbd2.out‚ 1.341796875 disk.sda1.out‚0" disk.nvme0n1.out‚ 34009.1640625 cpu‚25.743514681033115 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚610.58349609375 disk.md0p1.out‚ 588.12890625 disk.rbd0.out‚ 1.404296875 disk.sda1.in‚0 disk.md0.in‚ 67.2421875$ memory_percent‚92.66717433929443) proc.memory.availableMB‚ 1201.41015625 network.sent‚ 1.0362175e+07) disk./.usagePercent‚83.24688226998187 disk.sdb2.in‚9.453125 disk.sda.out‚610.58349609375 disk.md0.out‚ 588.12890625* proc.memory.percent‚18.830537796020508 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0! disk.nvme1n1.out‚ 32295.546875 disk.sdb.in‚9.453125 disk.sda2.in‚ 57.7890625! disk.sda2.out‚610.58349609375 network.recv‚ 1.720405e+06$ disk./.usageGB‚2977.311737060547 disk.rbd0.in‚0 disk.sdb1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.md0p1.in‚ 67.2421875 disk.sdb.out‚610.58349609375" proc.memory.rssMB‚ 3085.1953125 disk.sda.in‚ 57.7890625 proc.cpu.threads‚17å-Z2º- _wandbruntime‚5274  _runtime‚5274¥ ˜äȻ ' lr-AdamW/pg1‚0.00015889366107254435 ' lr-AdamW/pg2‚0.00015889366107254435 trainer/global_step‚4749 $ _timestamp‚1.788483622792523e+09 _runtime‚5274.902957742 _step‚383Ô|¶Í¼Ç _runtime‚5274.902957742 _step‚383 ' lr-AdamW/pg1‚0.00015889366107254435 ' lr-AdamW/pg2‚0.00015889366107254435 trainer/global_step‚4749 $ _timestamp‚1.788483622792523e+09ÿÇG@2½- _wandbruntime‚5274  _runtime‚5274-„ ö'¾ðO E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚564339313800704 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚529 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚24680952 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 190957904 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 105161276 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚650329584837632 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5204773380096 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚655534341178368 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚655534341178368 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚650329584837632 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 trainer/global_step‚4749 _runtime‚5274.904070536 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚639290766632816 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 _step‚384 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5205556856832 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5188083241539 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚564339130752512 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚558699009164288 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5640279732736 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚639290749593456 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚650329567798272 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 190981178 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 105161276 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚53364161 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 105161276 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚650329584837632 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5204773380096 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚655534341178368 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚655534341178368 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚650329584837632 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 trainer/global_step‚4749 _runtime‚5274.904070536 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚639290766632816 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 _step‚384 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5205556856832 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5188083241539 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚564339130752512 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚558699009164288 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5640279732736 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚639290749593456 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚650329567798272 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 190981178 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 105161276 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚53364161 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚564339313800704 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚529 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚24680952 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 190957904 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5206623208960 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚53374921 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚644609764299477 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚655668158829056 trainer/global_step‚4749 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚78060808 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 HBDeviceStatsMonitor.on_tra[¯in_batch_end/oversize_allocations.current‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚85814082 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 105182964 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚650462319110144 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚564454611362304 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚85814080 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚639421416833856 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5188364504981 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 105206262 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 105182964 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5641279554560 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 191020344 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 191020344 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5205839718912 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5206623208960 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚78061330 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚24686409 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚519 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚644610562820929 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 190997044 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5641433491456 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚655668959358464 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚85814080 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 190997044 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚650462319110144 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚522 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚246858905W*ú'ÂþM I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5205839718912 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚558813152967168 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 _step‚385 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚78060808 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚85814082 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 105182964 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚650462319110144 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚564454611362304 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚85814080 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚639421416833856 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5188364504981 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 105206262 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 105182964 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5641279554560 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 191020344 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 191020344 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5205839718912 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5206623208960 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚78061330 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚24686409 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚519 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚644610562820929 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 190997044 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5641433491456 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚655668959358464 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚85814080 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 190997044 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚650462319110144 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚522 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚24685890 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5206623208960 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚53374921 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚644609764299477 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚655668158829056 trainer/global_step‚4749 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 168368128 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚651063725843419 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚564406199308288 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚24931908 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚388 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚662225251540992 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚656967150431232 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚564406224211968 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚78834581 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚570104693576704 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 _runtime‚5325.541905828 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 192918256 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚662225251540992 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚656967150431232 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 192941530 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚645823259645456 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5241247679847 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5258118149120,G;’û'ÓõO E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚645823259645456 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5241247679847 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5258118149120 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 106249028 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚662226052057088 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚656967133391872 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 168368128 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚651063725843419 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚564406199308288 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚24931908 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚388 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚662225251540992 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚656967150431232 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚564406224211968 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚78834581 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚570104693576704 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 _runtime‚5325.541905828 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 192918256 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚662225251540992 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚656967150431232 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 192941530 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 106294014 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5699507386368 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚651195438789785 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 106270716 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5259967977984 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5259184487936 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚506 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚24936905 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚645953926885856 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 192957396 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 192957396 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚86686680 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚53912921 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 % _timestamp‚1.7884836743066363e+09 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚86686680 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚5326.417453579 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚657099884703744 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚78849823 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 192980696 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 106294014 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚78850329 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚570219850497536 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚662359869721088 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚651196237311237 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5241528943289 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5699648740352 trainer/global_step‚4799 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5259967977984 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚657099901743104 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚503 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5242310425381 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚570220016755200 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 166257664 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚662359069191680 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 141353984 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚645953909846496 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 192980696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚657099884703744 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚564520343111168 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 192980696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚657099884703744 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚564520343111168 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 106294014 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5699507386368 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚651195438789785 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 106270716 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5259967977984 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5259184487936 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚506 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚24936905 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚645953926885856 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 192957396 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 192957396 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚86686680 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚53912921 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 % _timestamp‚1.7884836743066363e+09 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚86686680 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 _runtime‚5326.417453579 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚657099884703744 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚78849823 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 192980696 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 106294014 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚78850329 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚570219850497536 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚662359869721088 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚651196237311237 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5241528943289 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5699648740352 trainer/global_step‚4799 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5259967977984 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚657099901743104 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚503 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 52423ûÄp“o10425381 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚570220016755200 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 166257664 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792…Ü]}2×- _wandbruntime‚5326  _runtime‚5326•D·]Ø× 2loss/SRqqt3/assignment_loss‚1.7733594243015562 1loss/FBt2/assignment_loss‚0.10514998200144958 0loss/SRqqt3/detection_loss‚2.705348341237931 %loss/total_loss‚38.52464249613333 _runtime‚5326.419440098 0loss/FRt3/assignment_loss‚3.1931381799140066 2loss/SRqqt1/assignment_loss‚1.0921660225777647 /loss/FRt4/detection_loss‚2.1045324744064158 epoch‚7 0loss/FBt3/assignment_loss‚0.2405594409717531 .loss/FRt1/detection_loss‚1.553618419682607 /loss/FBt3/detection_loss‚2.2855277939846643 /loss/FBt4/detection_loss‚2.5163709270326713 /loss/FRt4/assignment_loss‚3.316347139003949 2loss/SRqqt4/assignment_loss‚1.3017090395092965 1loss/SRqqt2/detection_loss‚1.2274117245442338 1loss/FBt1/assignment_loss‚0.16306935821657853 1loss/FBt4/assignment_loss‚0.25518739218242253 0loss/SRqqt4/detection_loss‚2.265162027799166 _step‚390 1loss/SRqqt1/detection_loss‚0.8730913164121482 trainer/global_step‚4799 $ _timestamp‚1.788483674309407e+09 /loss/FRt2/detection_loss‚2.0038708196197814 /loss/FRt3/detection_loss‚2.9883457112987086 /loss/FBt1/detection_loss‚0.6282116360585753 /loss/FBt2/detection_loss‚1.3599402780334156 0loss/FRt1/assignment_loss‚1.3690128836494226 0loss/FRt2/assignment_loss‚1.8735140164693196 2loss/SRqqt2/assignment_loss‚1.3299981472254903AøEbÙÜ 0loss/SRqqt3/detection_loss‚2.705348341237931 %loss/total_loss‚38.52464249613333 _runtime‚5326.419440098 0loss/FRt3/assignment_loss‚3.1931381799140066 2loss/SRqqt1/assignment_loss‚1.0921660225777647 /loss/FRt4/detection_loss‚2.1045324744064158 epoch‚7 0loss/FBt3/assignment_loss‚0.2405594409717531 .loss/FRt1/detection_loss‚1.553618419682607 /loss/FBt3/detection_loss‚2.2855277939846643 /loss/FBt4/detection_loss‚2.5163709270326713 /loss/FRt4/assignment_loss‚3.316347139003949 2loss/SRqqt4/assignment_loss‚1.3017090395092965 1loss/SRqqt2/detection_loss‚1.2274117245442338 1loss/FBt1/assignment_loss‚0.16306935821657853 1loss/FBt4/assignment_loss‚0.25518739218242253 0loss/SRqqt4/detection_loss‚2.265162027799166 _step‚390 1loss/SRqqt1/detection_loss‚0.8730913164121482 trainer/global_step‚4799 $ _timestamp‚1.788483674309407e+09 /loss/FRt2/detection_loss‚2.0038708196197814 /loss/FRt3/detection_loss‚2.9883457112987086 /loss/FBt1/detection_loss‚0.6282116360585753 /loss/FBt2/detection_loss‚1.3599402780334156 0loss/FRt1/assignment_loss‚1.3690128836494226 0loss/FRt2/assignment_loss‚1.8735140164693196 2loss/SRqqt2/assignment_loss‚1.3299981472254903 2loss/SRqqt3/assignment_loss‚1.7733594243015562 1loss/FBt2/assignment_loss‚0.10514998200144958†wµ(“Ú‚(:ˆ ç°èÔï“ß© gpu.0.gpu‚81.0 gpu.0.memory‚14, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚204.976' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.244 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0>¤OrÛ‚(:ç ç°èÔ•Áäª% disk./.usageGB‚2977.0597229003906 disk.sda1.in‚0# disk.nvme1n1.out‚32713.34765625 disk.sda2.out‚619.2373046875 disk.rbd0.in‚0 disk.sda.in‚ 57.7890625 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sdb2.in‚9.453125 disk.md0p1.in‚ 67.2421875 disk.sdb.in‚9.453125 disk.sda2.in‚ 57.7890625 disk.md0.in‚ 67.2421875 disk.md0.out‚ 596.47265625 disk.dm-0.out‚67442.90234375 cpu‚25.740115857379404 disk.sda.out‚619.2373046875 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚619.2373046875 disk.md0p1.out‚ 596.47265625$ memory_percent‚92.66750812530518) proc.memory.availableMB‚ 1201.35546875" proc.memory.rssMB‚ 3085.1953125 network.sent‚ 1.0472758e+07 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.in‚ 253.32421875 disk.rbd2.out‚ 1.341796875 network.recv‚ 1.742862e+06 disk.sda1.out‚0" disk.nvme0n1.out‚ 34729.5546875 disk.rbd0.out‚ 1.404296875 disk.rbd2.in‚0 proc.cpu.threads‚17) disk./.usagePercent‚83.23983584858779 disk.sdb2.out‚619.2373046875* proc.memory.percent‚18.830537796020508‘®•Ü‚(:Š ö°èÔ®ÛŠª gpu.0.gpu‚67.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚213.331' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.33275 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0•¢E÷mÝ‚(:â ö°èÔñ¿êª disk.dm-0.in‚ 253.32421875 disk.rbd2.in‚0) disk./.usagePercent‚83.20865150881136 disk.sdb.out‚620.85107421875! disk.sda2.out‚620.85107421875 disk.dm-0.out‚67614.56640625 disk.sdb1.out‚0 disk.sda.in‚ 57.7890625 disk.sdb1.in‚0 disk.sda1.out‚0 network.recv‚ 1.74724e+06 disk.sdb2.in‚9.453125 disk.sda.out‚620.85107421875# disk.nvme0n1.out‚34873.58984375! disk.sdb2.out‚620.85107421875 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 598.03125 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 cpu‚25.739400963837983 network.sent‚ 1.0558503e+07 disk.md0.out‚ 598.03125 disk.rbd0.out‚ 1.404296875 disk.rbd2.out‚ 1.341796875" disk.nvme1n1.out‚ 32740.9765625) proc.memory.availableMB‚ 1201.41796875 proc.cpu.threads‚17 disk.sda2.in‚ 57.7890625" proc.memory.rssMB‚ 3085.1953125# disk./.usageGB‚2975.94441986084 disk.sdb.in‚9.453125 disk.rbd0.in‚0 disk.nvme1n1.in‚ 32.45703125$ memory_percent‚92.66712665557861* proc.memory.percent‚18.830537796020508 disk.md0p1.in‚ 67.2421875Ó‚@©ŸÞ‚(:” …±èÔ¯ŒÔ« gpu.0.gpu‚76.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚242.803' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚60.700750000000006 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0=2ôËdß‚(:Ù …±èÔó ¬ disk.sda.out‚622.2490234375 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚622.2490234375 disk.sda2.out‚622.2490234375 disk.md0p1.out‚599.375 disk.sdb1.in‚0* proc.memory.percent‚18.835806846618652 disk.sda1.in‚0 disk.nvme0n1.out‚ 34994.9375 disk.rbd2.in‚0 proc.cpu.threads‚17 network.recv‚ 1.752248e+06# proc.memory.rssMB‚ 3086.05859375) disk./.usagePercent‚83.21719885721346$ disk./.usageGB‚2976.250114440918# disk.nvme1n1.out‚32893.80078125 disk.sdb2.out‚622.2490234375 disk.md0p1.in‚ 67.2421875 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚67888.73828125$ memory_percent‚92.67332553863525 network.sent‚ 1.0567505e+07 disk.sdb2.in‚9.453125 disk.sda2.in‚ 57.7890625 disk.md0.out‚599.375 disk.sdb1.out‚0) proc.memory.availableMB‚ 1200.40234375 disk.sda.in‚ 57.7890625 disk.nvme0n1.in‚ 220.8671875 disk.rbd0.in‚0 disk.rbd2.out‚ 1.341796875 disk.sda1.out‚0 disk.sdb.in‚9.453125 disk.md0.in‚ 67.2421875 cpu‚25.74815591046462 disk.rbd0.out‚ 1.404296875”­ý•à‚(:Š ”±èÔìÖ¥« gpu.0.gpu‚83.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚239.401' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚59.85025 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0pŠ vá‚(:ë ”±èÔ׎…¬ disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.7890625 disk.sda.out‚624.41162109375 disk.sda1.in‚0) proc.memory.availableMB‚ 1200.83984375 disk.rbd2.out‚ 1.341796875 disk.nvme0n1.in‚ 220.8671875# disk.nvme1n1.out‚32945.97265625 disk.md0.in‚ 67.2421875 disk.md0.out‚ 601.48046875 disk.sdb.in‚9.453125! disk.sda2.out‚624.41162109375 disk.rbd2.in‚0 disk.sdb1.in‚0 cpu‚25.760245015113416 network.sent‚ 1.0571721e+07 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚ 601.48046875 disk.dm-0.out‚67940.98046875$ memory_percent‚92.67065525054932# proc.memory.rssMB‚ 3086.05859375! disk.sdb2.out‚624.41162109375 disk.sdb1.out‚0* proc.memory.percent‚18.835806846618652 proc.cpu.threads‚17 disk.rbd0.in‚0 network.recv‚ 1.755059e+06) disk./.usagePercent‚83.21719843057133$ disk./.usageGB‚2976.250099182129 disk.sdb2.in‚9.453125 disk.sda1.out‚0" disk.nvme0n1.out‚ 34995.0078125 disk.sdb.out‚624.41162109375 disk.rbd0.out‚ 1.404296875 disk.dm-0.in‚ 253.32421875 disk.sda.in‚ 57.7890625I×>Ùžâ‚(:“ £±èÔôŸª gpu.0.gpu‚74.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚223.308' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚55.82699999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ze²'`ã‚(:Õ £±èÔæéñª disk.sdb2.out‚ 625.8671875 disk.dm-0.in‚ 253.32421875) proc.memory.availableMB‚ 1178.82421875* proc.memory.percent‚18.967771530151367 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.8671875" disk.nvme1n1.out‚ 33051.7890625$ memory_percent‚92.80502796173096 network.sent‚ 1.0576086e+07 disk.sda1.in‚0 disk.sdb.out‚ 625.8671875 disk.sda2.in‚ 57.7890625" proc.memory.rssMB‚ 3107.6796875 network.recv‚ 1.759888e+06 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.453125 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 602.87890625 cpu‚25.7731964279109) disk./.usagePercent‚83.21719853723187 disk.sdb2.in‚9.453125 disk.md0p1.in‚ 67.2421875 disk.rbd2.out‚ 1.341796875 proc.cpu.threads‚17 disk.sda.in‚ 57.7890625! disk.nvme0n1.out‚ 34995.234375 disk.sda2.out‚ 625.8671875 disk.rbd0.in‚0 disk.rbd0.out‚ 1.404296875 disk.rbd2.in‚0$ disk./.usageGB‚2976.250102996826 disk.sda.out‚ 625.8671875 disk.md0.out‚ 602.87890625 disk.dm-0.out‚ 68047.0234375 disk.sda1.out‚0´;qà2ä- _wandbruntime‚5400  _runtime‚5400‘è5GëTåΨ :"Purity/3FRt0SRqqt*FBt/event_purity‚0.01515151560306549 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 particle/accuracy_2_of_4‚1 _runtime‚5400.866987109 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9806547164916992 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 _step‚391 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017840804532170296 particle/accuracy_4_of_6‚1 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9926124215126038 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.18568041920661926 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.08256331086158752 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.4049905240535736 *jet/accuracy_1_of_3‚0.8491666316986084 particle/accuracy_1_of_2‚1 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6513218283653259 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5086805820465088 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 6validation_average_jet_accuracy‚0.4166649580001831 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5419730544090271 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9946236610412598 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 7 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.2592261731624603 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.4029504060745239 )loss/val_total_loss‚37.81652652702259 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9981541633605957 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.23410384356975555 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.17916665971279144 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.40587690472602844 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8094983696937561 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.43940097093582153 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.27016472816467285 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5355419516563416 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9916252493858337 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 :"Purity/0FRt*SRqqt0FBt/event_purity‚0.32203447818756104 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2703017294406891 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2396240085363388 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.19681444764137268 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.9987593293190002 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.15802611410617828 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3055555522441864 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.34375 jet/accuracy_6_of_7‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 ) Purity/4FRt*SRqqt0FBt/FRt_purity‚0.25 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.40902501344680786 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7000501751899719 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9985849261283875 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.07148148119449615 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4679487347602844 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 *jet/accuracy_1_of_4‚0.9126020073890686 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.16596785187721252 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 % _timestamp‚1.7884837487537286e+09 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 6 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.929563581943512 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.1805555671453476 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.32297980785369873 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.028888888657093048 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5496598482131958 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.21568624675273895 jet/accuracy_6_of_6‚0 9"Purity/0FRt*SRqqt3FBt/event_purity‚0.1111111044883728 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.42533284425735474 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.05772487446665764 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.20338623225688934 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 jet/accuracy_7_of_7‚0 particle/accuracy_4_of_7‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9919722676277161 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.261904776096344 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9975894093513489 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9911505579948425 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_5_of_5‚1 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.21531203389167786 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 jet/accuracy_5_of_6‚0 particle/accuracy_3_of_7‚1 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.40219739079475403 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.29721787571907043 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.38986289501190186 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.25641027092933655 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.30000001192092896 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.42222222685813904 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 jet/accuracy_4_of_7‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9985849261283875 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5195468664169312 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.12666583061218262 6 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.305757075548172 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.27877622842788696 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4260956645011902 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.967886745929718 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 (particle/accuracy‚0.8506437540054321 7 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.3499999940395355 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5287001729011536 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9879009127616882 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.43132084608078003 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 particle/accuracy_2_of_5‚1 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4309902489185333 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,jet/accuracy_3_of_3‚0.030163602903485298 particle/accuracy_4_of_4‚1 particle/accuracy_7_of_7‚1 7 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.1907685399055481 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 7 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.2531979978084564 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.01785714365541935 7"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.80952388048172 :"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.41251102089881897 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.42165616154670715 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.40848851203918457 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.23775723576545715 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2222222238779068 +jet/accuracy_4_of_6‚0.02631578966975212 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.041360609233379364 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.37132933735847473 ( Purity/4FRt1SRqqt*FBt/FRt_purity‚0.5 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0011947430903092027 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3839682340621948 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 particle/accuracy_3_of_6‚1 9"Purity/*FRt*SRqqt1FBt/event_purity‚0.4207218587398529 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8999999761581421 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11472808569669724 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.31019121408462524 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.33106762170791626 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 8"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.436199426651001 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 trainer/global_step‚4831 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 *jet/accuracy_2_of_6‚0.5789473652839661 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.4056053161621094 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.44206035137176514 ,jet/accuracy_4_of_5‚0.007857734337449074 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 particle/accuracy_2_of_7‚1 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9311111569404602 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.09375 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 +jet/accuracy_2_of_2‚0.10919349640607834 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.4056053161621094 :"Purity/1FRt1SRqqt*FBt/event_purity‚0.02186826802790165 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.00358422938734293 /"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.328125 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.004608294926583767 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.25665390491485596 9"Purity/0FRt1SRqqt*FBt/event_purity‚0.3437967002391815 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 6 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.920634925365448 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.19689016044139862 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.4098832607269287 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6428571343421936 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.45364829897880554 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2548244893550873 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.43275484442710876 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.020304305478930473 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.006828727666288614 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9885269999504089 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 8"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.694444477558136 (particle/f_score‚0.40995556116104126 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.006400409620255232 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.21768128871917725 ;"Purity/1FRt2SRqqt*FBt/event_purity‚0.002264420734718442 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 8"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.413036584854126 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7938596606254578 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_5‚1 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.23883450031280518 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.7002976536750793 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3203125 particle/accuracy_6_of_6‚1 particle/accuracy_1_of_7‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22695419192314148 & Purity/0FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 :"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.43947550654411316 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5337927937507629 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5013240575790405 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.19333334267139435 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.006451612804085016 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.21049784123897552 particle/accuracy_2_of_2‚1 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.4540204405784607 <"Purity/2FRt1SRqqt0FBt/event_purity‚0.0037220846861600876 :"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.45500820875167847 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.00909090880304575 :"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.38749998807907104 ,particle/sensitivity‚0.33231672644615173 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9991409182548523 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6333333253860474 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5157236456871033 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.1944444477558136 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3501055836677551 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.3814865052700043 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2115854024887085 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.029169945046305656 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.3695635199546814 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5510618090629578 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9911383390426636 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24100100994110107 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4728260934352875 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.0001260eËÎj?0806076079607 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 particle/accuracy_3_of_5‚1 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.36666667461395264 7"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.80952388048172 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.261904776096344 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9920900464057922 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9876488447189331 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.43515393137931824 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.4429824650287628 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.04534413665533066 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9983566403388977 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.3214285671710968 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.43860700726509094 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4188326597213745 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.5854839086532593 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.32323238253593445 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 particle/accuracy_5_of_6‚1 particle/accuracy_6_of_7‚1 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.4975000023841858 :"Purity/2FRt0SRqqt0FBt/event_purity‚0.01549458596855402 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 particle/accuracy_2_of_6‚1 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 6 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.538690447807312 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.4512789249420166 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.3680555820465088 :"Purity/0FRt0SRqqt2FBt/event_purity‚0.32217490673065186 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4753086566925049 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 *jet/accuracy_1_of_1‚0.4498440623283386 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.36773771047592163 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.36102670431137085 *jet/accuracy_2_of_5‚0.5083330869674683 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9907671809196472 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.04285714402794838 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 jet/accuracy_5_of_5‚0 epoch‚7 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 8"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.457509309053421 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.30000001192092896 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2617420256137848 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 7 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.2077927440404892 :"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.48918330669403076 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4095729887485504 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.42104074358940125 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 8"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.428840696811676 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3749999701976776 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9981312155723572 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6176470518112183 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09878180921077728 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.17300307750701904 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 :"Purity/*FRt2SRqqt0FBt/event_purity‚0.01828264631330967 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9926950335502625 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9974019527435303 * Purity/1FRt*SRqqt3FBt/FRt_purity‚0.625 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5569469928741455 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.01887238770723343 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.2557879686355591 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.20370371639728546 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 particle/accuracy_3_of_3‚1 8"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.523809552192688 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.22531309723854065 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4757407605648041 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.42222222685813904 jet/accuracy_1_of_6‚1 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 ) Purity/4FRt*SRqqt*FBt/FRt_purity‚0.25 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22054719924926758 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.21768128871917725 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 <"Purity/2FRt1SRqqt*FBt/event_purity‚0.0025766808539628983 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.004927137400954962 particle/accuracy_4_of_5‚1 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ,"Purity/0FRt3SRqqt1FBt/event_purity‚0.125 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.04595493897795677 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9912794828414917 +particle/specificity‚0.9465771913528442 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.1805555671453476 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5739479660987854 particle/accuracy_1_of_6‚1 jet/accuracy_2_of_7‚0.5 jet/accuracy_5_of_7‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.012092593125998974 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1339285671710968 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_1_of_7‚1 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 7 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.4166666865348816 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 +jet/accuracy_2_of_3‚0.24109992384910583 *jet/accuracy_3_of_5‚0.1044173613190651 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.03846153989434242 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_1_of_5‚0.9471439123153687 particle/accuracy_3_of_4‚1 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3769841194152832 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04097115993499756 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.09195402264595032 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9204981327056885 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.30392584204673767 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.37159866094589233 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 + Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9375 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.18536093831062317 5 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.98287034034729 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt0SRqqt0FBt/event_purity‚0.1842479705810547 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5078480839729309 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.18212655186653137 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.27932512760162354 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.42843592166900635 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5400218963623047 ;"Purity/2FRt*SRqqt1FBt/event_purity‚0.026478474959731102 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 :"Purity/*FRt3SRqqt1FBt/event_purity‚0.02380952425301075 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.5801346898078918 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 *jet/accuracy_1_of_2‚0.7318228483200073 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 particle/accuracy_5_of_7‚1 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4194246530532837 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1071428582072258 ,jet/accuracy_3_of_4‚0.056592658162117004 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3205128312110901 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.4405498206615448 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.20601852238178253 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 7 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.4055555462837219 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.20047400891780853 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 9"Purity/0FRt1SRqqt1FBt/event_purity‚0.1900353580713272 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 +jet/accuracy_3_of_6‚0.14035087823867798 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3068738281726837 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9906237125396729 8 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.44098639488220215 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 :"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.48316138982772827 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.17018085718154907 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6172211170196533 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 jet/accuracy_3_of_7‚0 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.20961904525756836 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 7 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.1781889647245407 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 6 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.252073734998703 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3095340132713318 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 +jet/accuracy_2_of_4‚0.35482704639434814 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2723447382450104 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.02182539738714695 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.4980858564376831 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23387263715267181 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ( Purity/4FRt1SRqqt0FBt/FRt_purity‚0.5 :"Purity/*FRt0SRqqt2FBt/event_purity‚0.24423007667064667 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9835455417633057 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5087968111038208 particle/accuracy_2_of_3‚1 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.4615384638309479 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11371137946844101 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.044976748526096344 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7587718963623047 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 particle/accuracy_1_of_4‚1 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 8"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.523809552192688 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.9135802984237671 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9939948916435242 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0HCˆ@æÓ¨ ("Purity/3FRt2SRqqt0FBt/event_purity‚0 particle/accuracy_3_of_5‚1 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.36666667461395264 7"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.80952388048172 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.261904776096344 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9920900464057922 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9876488447189331 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.43515393137931824 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.4429824650287628 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.04534413665533066 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9983566403388977 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.3214285671710968 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 :"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.43860700726509094 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.4188326597213745 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.5854839086532593 8 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.32323238253593445 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 particle/accuracy_5_of_6‚1 particle/accuracy_6_of_7‚1 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.4975000023841858 :"Purity/2FRt0SRqqt0FBt/event_purity‚0.01549458596855402 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 particle/accuracy_2_of_6‚1 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 6 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.538690447807312 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.4512789249420166 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.3680555820465088 :"Purity/0FRt0SRqqt2FBt/event_purity‚0.32217490673065186 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4753086566925049 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 *jet/accuracy_1_of_1‚0.4498440623283386 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.36773771047592163 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 & Purity/1FRt4SRqqt0FBt/FRt_purity‚0 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.36102670431137085 *jet/accuracy_2_of_5‚0.5083330869674683 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9907671809196472 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.04285714402794838 ("Purity/2FRt1SRqqt1FBt/event_purity‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 jet/accuracy_5_of_5‚0 epoch‚7 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 8"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.457509309053421 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.30000001192092896 7 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.2617420256137848 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 7 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.2077927440404892 :"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.48918330669403076 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.4095729887485504 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 :"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.42104074358940125 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 8"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.428840696811676 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3749999701976776 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9981312155723572 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6176470518112183 :"Purity/1FRt*SRqqt0FBt/event_purity‚0.09878180921077728 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.17300307750701904 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 :"Purity/*FRt2SRqqt0FBt/event_purity‚0.01828264631330967 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9926950335502625 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9974019527435303 * Purity/1FRt*SRqqt3FBt/FRt_purity‚0.625 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5569469928741455 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.01887238770723343 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 7 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.2557879686355591 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.20370371639728546 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 particle/accuracy_3_of_3‚1 8"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.523809552192688 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.22531309723854065 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4757407605648041 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.42222222685813904 jet/accuracy_1_of_6‚1 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 ) Purity/4FRt*SRqqt*FBt/FRt_purity‚0.25 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22054719924926758 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.21768128871917725 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 <"Purity/2FRt1SRqqt*FBt/event_purity‚0.0025766808539628983 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.004927137400954962 particle/accuracy_4_of_5‚1 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 & Purity/0FRt3SRqqt*FBt/FBt_purity‚1 ,"Purity/0FRt3SRqqt1FBt/event_purity‚0.125 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.04595493897795677 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9912794828414917 +particle/specificity‚0.9465771913528442 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.1805555671453476 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5739479660987854 particle/accuracy_1_of_6‚1 jet/accuracy_2_of_7‚0.5 jet/accuracy_5_of_7‚0 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.012092593125998974 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1339285671710968 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 jet/accuracy_1_of_7‚1 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 7 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.4166666865348816 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 +jet/accuracy_2_of_3‚0.24109992384910583 *jet/accuracy_3_of_5‚0.1044173613190651 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.03846153989434242 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_1_of_5‚0.9471439123153687 particle/accuracy_3_of_4‚1 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3769841194152832 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04097115993499756 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/*FRt0SRqqt4FBt/FRt_purity‚1 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.09195402264595032 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9204981327056885 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.30392584204673767 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.37159866094589233 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 + Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9375 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.18536093831062317 5 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.98287034034729 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt0SRqqt0FBt/event_purity‚0.1842479705810547 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5078480839729309 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.18212655186653137 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.27932512760162354 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.30000001192092896 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.42843592166900635 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5400218963623047 ;"Purity/2FRt*SRqqt1FBt/event_purity‚0.026478474959731102 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 :"Purity/*FRt3SRqqt1FBt/event_purity‚0.02380952425301075 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.5801346898078918 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 *jet/accuracy_1_of_2‚0.7318228483200073 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 particle/accuracy_5_of_7‚1 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 7 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.4194246530532837 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1071428582072258 ,jet/accuracy_3_of_4‚0.056592658162117004 7 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.3205128312110901 ("Purity/1FRt*SRqqt3FBt/SRqqt_purity‚1 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 9"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.4405498206615448 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.20601852238178253 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 7 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.4055555462837219 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.20047400891780853 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 9"Purity/0FRt1SRqqt1FBt/event_purity‚0.1900353580713272 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 +jet/accuracy_3_of_6‚0.14035087823867798 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3068738281726837 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9906237125396729 8 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.44098639488220215 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 :"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.48316138982772827 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.17018085718154907 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6172211170196533 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 particle/accuracy_1_of_1‚1 jet/accuracy_3_of_7‚0 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.20961904525756836 & Purity/1FRt0SRqqt4FBt/FRt_purity‚1 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 7 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.1781889647245407 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 6 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.252073734998703 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3095340132713318 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 +jet/accuracy_2_of_4‚0.35482704639434814 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2723447382450104 :"Purity/0FRt3SRqqt*FBt/event_purity‚0.02182539738714695 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.4980858564376831 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23387263715267181 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 ( Purity/4FRt1SRqqt0FBt/FRt_purity‚0.5 :"Purity/*FRt0SRqqt2FBt/event_purity‚0.24423007667064667 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9835455417633057 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5087968111038208 particle/accuracy_2_of_3‚1 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.4615384638309479 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11371137946844101 & Purity/*FRt3SRqqt1FBt/FBt_purity‚1 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.044976748526096344 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7587718963623047 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 particle/accuracy_1_of_4‚1 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 8"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.523809552192688 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.9135802984237671 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9939948916435242 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.01515151560306549 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 particle/accuracy_2_of_4‚1 _runtime‚5400.866987109 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9806547164916992 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 _step‚391 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116î¥ÈÒS869390011 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017840804532170296 particle/accuracy_4_of_6‚1 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9926124215126038 :"Purity/*FRt1SRqqt*FBt/event_purity‚0.18568041920661926 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 :"Purity/1FRt*SRqqt2FBt/event_purity‚0.08256331086158752 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 9"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.4049905240535736 *jet/accuracy_1_of_3‚0.8491666316986084 particle/accuracy_1_of_2‚1 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6513218283653259 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5086805820465088 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 6validation_average_jet_accuracy‚0.4166649580001831 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5419730544090271 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9946236610412598 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 7 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.2592261731624603 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 9"Purity/*FRt0SRqqt*FBt/event_purity‚0.4029504060745239 )loss/val_total_loss‚37.81652652702259 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9981541633605957 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9912924766540527 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.23410384356975555 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.17916665971279144 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 :"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.40587690472602844 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8094983696937561 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.43940097093582153 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 8 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.27016472816467285 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5355419516563416 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9916252493858337 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 :"Purity/0FRt*SRqqt0FBt/event_purity‚0.32203447818756104 7 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.2703017294406891 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 7 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.2396240085363388 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.19681444764137268 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt1SRqqt1FBt/FBt_purity‚0.9987593293190002 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.15802611410617828 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.3055555522441864 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ."Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.34375 jet/accuracy_6_of_7‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 ) Purity/4FRt*SRqqt0FBt/FRt_purity‚0.25 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.40902501344680786 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7000501751899719 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9985849261283875 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.07148148119449615 7 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.4679487347602844 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 *jet/accuracy_1_of_4‚0.9126020073890686 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.30000001192092896 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.16596785187721252 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 % _timestamp‚1.7884837487537286e+09 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 6 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.929563581943512 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.1805555671453476 ( Purity/*FRt*SRqqt4FBt/FRt_purity‚0.5 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.32297980785369873 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 ( Purity/1FRt*SRqqt4FBt/FRt_purity‚0.5 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.028888888657093048 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5496598482131958 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.21568624675273895 jet/accuracy_6_of_6‚0 9"Purity/0FRt*SRqqt3FBt/event_purity‚0.1111111044883728 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 :"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.42533284425735474 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.05772487446665764 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.20338623225688934 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 jet/accuracy_7_of_7‚0 particle/accuracy_4_of_7‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9919722676277161 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.261904776096344 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9975894093513489 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9911505579948425 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_5_of_5‚1 & Purity/1FRt4SRqqt*FBt/FRt_purity‚0 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.21531203389167786 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 jet/accuracy_5_of_6‚0 particle/accuracy_3_of_7‚1 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.40219739079475403 8 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.29721787571907043 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.38986289501190186 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.25641027092933655 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.30000001192092896 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 & Purity/0FRt3SRqqt1FBt/FBt_purity‚1 8 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.42222222685813904 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 jet/accuracy_4_of_7‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9985849261283875 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5195468664169312 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.12666583061218262 6 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.305757075548172 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.27877622842788696 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4260956645011902 6 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.967886745929718 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 (particle/accuracy‚0.8506437540054321 7 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.3499999940395355 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5287001729011536 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9879009127616882 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.43132084608078003 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 particle/accuracy_2_of_5‚1 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4309902489185333 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 ,jet/accuracy_3_of_3‚0.030163602903485298 particle/accuracy_4_of_4‚1 particle/accuracy_7_of_7‚1 7 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.1907685399055481 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 7 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.2531979978084564 :"Purity/0FRt3SRqqt0FBt/event_purity‚0.01785714365541935 7"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.80952388048172 :"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.41251102089881897 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.42165616154670715 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.40848851203918457 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.23775723576545715 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2222222238779068 +jet/accuracy_4_of_6‚0.02631578966975212 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.041360609233379364 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.37132933735847473 ( Purity/4FRt1SRqqt*FBt/FRt_purity‚0.5 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0011947430903092027 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3839682340621948 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 particle/accuracy_3_of_6‚1 9"Purity/*FRt*SRqqt1FBt/event_purity‚0.4207218587398529 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8999999761581421 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11472808569669724 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.31019121408462524 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.33106762170791626 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 8"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.436199426651001 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 trainer/global_step‚4831 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 *jet/accuracy_2_of_6‚0.5789473652839661 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.4056053161621094 8 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.44206035137176514 ,jet/accuracy_4_of_5‚0.007857734337449074 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 particle/accuracy_2_of_7‚1 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9311111569404602 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.09375 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 +jet/accuracy_2_of_2‚0.10919349640607834 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.4056053161621094 :"Purity/1FRt1SRqqt*FBt/event_purity‚0.02186826802790165 :"Purity/3FRt*SRqqt*FBt/event_purity‚0.00358422938734293 /"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.328125 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 & Purity/*FRt3SRqqt*FBt/FBt_purity‚1 ;"Purity/*FRt3SRqqt0FBt/event_purity‚0.004608294926583767 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.25665390491485596 9"Purity/0FRt1SRqqt*FBt/event_purity‚0.3437967002391815 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 6 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.920634925365448 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.19689016044139862 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.4098832607269287 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6428571343421936 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.45364829897880554 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2548244893550873 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.43275484442710876 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.020304305478930473 ;"Purity/2FRt*SRqqt0FBt/event_purity‚0.006828727666288614 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.8333333730697632 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9885269999504089 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 8"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.694444477558136 (particle/f_score‚0.40995556116104126 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.006400409620255232 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.21768128871917725 ;"Purity/1FRt2SRqqt*FBt/event_purity‚0.002264420734718442 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 8"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.413036584854126 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7938596606254578 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_5‚1 :"Purity/*FRt*SRqqt*FBt/event_purity‚0.23883450031280518 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.7002976536750793 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.3203125 particle/accuracy_6_of_6‚1 particle/accuracy_1_of_7‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22695419192314148 & Purity/0FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 :"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.43947550654411316 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5337927937507629 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5013240575790405 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.19333334267139435 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.006451612804085016 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.21049784123897552 particle/accuracy_2_of_2‚1 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.4540204405784607 <"Purity/2FRt1SRqqt0FBt/event_purity‚0.0037220846861600876 :"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.45500820875167847 :"Purity/3FRt*SRqqt1FBt/event_purity‚0.00909090880304575 :"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.38749998807907104 ,particle/sensitivity‚0.33231672644615173 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9991409182548523 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6333333253860474 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5157236456871033 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ("Purity/1FRt1SRqqt3FBt/SRqqt_purity‚1 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.1944444477558136 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3501055836677551 9"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.3814865052700043 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2115854024887085 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.029169945046305656 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.3695635199546814 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5510618090629578 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9911383390426636 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24100100994110107 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4728260934352875 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0‡™Ÿç‚(:” ²±èÔýΠª gpu.0.gpu‚72.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ç‰êÀqè‚(:æ ²±èÔ€èȪ disk.rbd0.out‚ 1.404296875 disk.dm-0.out‚68145.19921875 disk.md0p1.in‚ 67.2421875# disk.nvme0n1.out‚34996.67578125$ memory_percent‚92.67210960388184* proc.memory.percent‚18.835806846618652 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 network.recv‚ 1.763283e+06 disk.sdb2.out‚627.6572265625# proc.memory.rssMB‚ 3086.05859375 disk.sda.in‚ 57.7890625 disk.sda1.out‚0" disk.nvme1n1.out‚ 33148.5234375 disk.sdb2.in‚9.453125 proc.cpu.threads‚17( disk./.usagePercent‚83.2136975119255 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 604.58984375 disk.rbd2.out‚ 1.341796875 disk.sdb.out‚627.6572265625 disk.sda2.in‚ 57.7890625 disk.sdb1.in‚0( proc.memory.availableMB‚ 1200.6015625 disk.rbd0.in‚0 network.sent‚ 1.0581115e+07 disk.sda2.out‚627.6572265625 disk.md0.out‚ 604.58984375 disk.rbd2.in‚0 disk.sda.out‚627.6572265625 disk.sdb.in‚9.453125% disk./.usageGB‚2976.1248893737793 disk.dm-0.in‚ 253.32421875 disk.sdb1.out‚0 cpu‚25.773869478470925ÙNÜg2é- _wandbruntime‚5417  _runtime‚5417VÛe9Éêà ' lr-AdamW/pg1‚0.00013617703125865581 ' lr-AdamW/pg2‚0.00013617703125865581 trainer/global_step‚4849 % _timestamp‚1.7884837658254428e+09 _runtime‚5417.936084799 _step‚392ÿ ¥ÎëÈ ' lr-AdamW/pg1‚0.00013617703125865581 ' lr-AdamW/pg2‚0.00013617703125865581 trainer/global_step‚4849 % _timestamp‚1.7884837658254428e+09 _runtime‚5417.936084799 _step‚392ˆE×w¸2ì- _wandbruntime‚5417  _runtime‚5417Ï´Ïqë#íïO [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 195553244 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚671753522716672 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚54761876 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5776521191424 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 195576518 _step‚393 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚660335574999404 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5313156139200 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚671752722200576 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 107598496 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚25313351 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5331036910592 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5331820387328 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚87954748 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 107621768 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚666421685289984 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚538 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5313937621084 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚541 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚666421685289984 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 107598496 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5776356755456 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚578240911107072 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚572464389915648 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 `LDeviceStatsMoKSƒ nitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚666421702329344 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 195576518 _step‚393 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚660335574999404 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5313156139200 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚671752722200576 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 107598496 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚25313351 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5331036910592 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5331820387328 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚87954748 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 107621768 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚666421685289984 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚538 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5313937621084 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚541 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚666421685289984 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 107598496 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5776356755456 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚578240911107072 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚572464389915648 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚666421702329344 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5332103249408 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚87972202 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚671886539851264 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚666554436601856 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 $ _timestamp‚1.788483766650538e+09 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚671887340380672 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚80090838 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚578356201929216 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚572578508814848 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 195615684 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚87972200 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚660466489424526 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚54772639 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _step‚394 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 _runtime‚5418.762008879 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 107643482 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚80090323 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5315000366618 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚87972200 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚572578533718528 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 195615684 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 195592384ÕÐ^r'ñþM FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 195615684 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 195592384 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚655152287579360 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5332886739456 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5314218884526 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5332103249408 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚87972202 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚671886539851264 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚666554436601856 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 $ _timestamp‚1.788483766650538e+09 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚671887340380672 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚80090838 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚578356201929216 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚572578508814848 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 195615684 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚87972200 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚660466489424526 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚54772639 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _step‚394 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 _runtime‚5418.762008879 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 107643482 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚80090323 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5315000366618 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚87972200 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚572578533718528 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0Š~å=ø2ò- _wandbruntime‚5418  _runtime‚5418/å ¥]ó× /loss/FRt3/assignment_loss‚3.308191861425127 1loss/SRqqt2/assignment_loss‚1.131075818781982 1loss/FBt1/assignment_loss‚0.12954835397385267 1loss/FBt3/assignment_loss‚0.14012788168426482 .loss/FBt4/detection_loss‚4.344301260179943 epoch‚8 0loss/FRt2/assignment_loss‚1.6353245955882687 2loss/SRqqt4/assignment_loss‚1.6312308681507905 0loss/FBt2/assignment_loss‚0.0963587165441453 /loss/SRqqt4/detection_loss‚2.29494993686676 /loss/FBt2/detection_loss‚1.4063529497426417 /loss/FRt1/detection_loss‚1.6294662267765374 1loss/SRqqt3/detection_loss‚2.3879975963722577 /loss/FBt1/detection_loss‚0.6010605175494371 2loss/SRqqt3/assignment_loss‚1.5164420318874445 /loss/FRt4/detection_loss‚2.0952306690349993 &loss/total_loss‚39.225498072851664 % _timestamp‚1.7884837666529353e+09 2loss/FBt4/assignment_loss‚0.047497440070300295 /loss/FRt3/detection_loss‚3.0784442704551074 0loss/SRqqt2/detection_loss‚1.140171169961145 .loss/FBt3/detection_loss‚2.538810459896922 0loss/FRt1/assignment_loss‚1.1956290238111922 1loss/SRqqt1/detection_loss‚1.0928645571302467 0loss/FRt4/assignment_loss‚3.0510181130274483 _runtime‚5418.762972674 _step‚395 2loss/SRqqt1/assignment_loss‚0.8192044553980857 /loss/FRt2/detection_loss‚1.9141992985427674 trainer/global_step‚4849¡Ž <x¼³ÉbôÜ 0loss/FRt4/assignment_loss‚3.0510181130274483 _runtime‚5418.762972674 _step‚395 2loss/SRqqt1/assignment_loss‚0.8192044553980857 /loss/FRt2/detection_loss‚1.9141992985427674 trainer/global_step‚4849 /loss/FRt3/assignment_loss‚3.308191861425127 1loss/SRqqt2/assignment_loss‚1.131075818781982 1loss/FBt1/assignment_loss‚0.12954835397385267 1loss/FBt3/assignment_loss‚0.14012788168426482 .loss/FBt4/detection_loss‚4.344301260179943 epoch‚8 0loss/FRt2/assignment_loss‚1.6353245955882687 2loss/SRqqt4/assignment_loss‚1.6312308681507905 0loss/FBt2/assignment_loss‚0.0963587165441453 /loss/SRqqt4/detection_loss‚2.29494993686676 /loss/FBt2/detection_loss‚1.4063529497426417 /loss/FRt1/detection_loss‚1.6294662267765374 1loss/SRqqt3/detection_loss‚2.3879975963722577 /loss/FBt1/detection_loss‚0.6010605175494371 2loss/SRqqt3/assignment_loss‚1.5164420318874445 /loss/FRt4/detection_loss‚2.0952306690349993 &loss/total_loss‚39.225498072851664 % _timestamp‚1.7884837666529353e+09 2loss/FBt4/assignment_loss‚0.047497440070300295 /loss/FRt3/detection_loss‚3.0784442704551074 0loss/SRqqt2/detection_loss‚1.140171169961145 .loss/FBt3/detection_loss‚2.538810459896922 0loss/FRt1/assignment_loss‚1.1956290238111922 1loss/SRqqt1/detection_loss‚1.0928645571302467‹’@Aý“õ‚(:ˆ Á±èÔ“Ά« gpu.0.gpu‚58.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚226.37' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.5925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0«Gègö‚(:Ü Á±èÔøìë network.recv‚ 1.769037e+06 disk.sda.out‚629.62939453125 disk.sdb.in‚9.453125 disk.rbd0.in‚0 disk.rbd0.out‚ 1.404296875 disk.dm-0.in‚ 253.32421875$ disk./.usageGB‚2976.031608581543 disk.sdb1.out‚0 disk.sda1.out‚0! disk.sdb2.out‚629.62939453125 disk.sda2.in‚ 57.7890625 disk.rbd2.in‚0 disk.nvme1n1.in‚ 32.45703125 cpu‚25.773291385041667 proc.cpu.threads‚17 network.sent‚ 1.0697592e+07 disk.rbd2.out‚ 1.341796875 disk.nvme0n1.in‚ 220.8671875 disk.sdb.out‚629.62939453125 disk.sdb2.in‚9.453125) disk./.usagePercent‚83.21108934193353 disk.md0.in‚ 67.2421875 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚606.5# disk.nvme0n1.out‚34996.83984375# proc.memory.rssMB‚ 3086.05859375! disk.sda2.out‚629.62939453125$ memory_percent‚92.67451763153076* proc.memory.percent‚18.835806846618652 disk.sdb1.in‚0 disk.sda.in‚ 57.7890625 disk.sda1.in‚0# disk.nvme1n1.out‚33368.55078125 disk.md0.out‚606.5 disk.dm-0.out‚ 68365.390625) proc.memory.availableMB‚ 1200.20703125Fv\ì“÷‚(:ˆ бèԵʫ gpu.0.gpu‚81.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚123.712' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚30.928 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0YëVkø‚(:à бèÔ¸÷£­ disk.md0.out‚ 608.53515625 disk.md0p1.in‚ 67.2421875# disk.nvme1n1.out‚33504.65234375 disk.sdb2.in‚9.453125 disk.sda2.out‚ 631.728515625# proc.memory.rssMB‚ 3086.05859375 network.recv‚ 1.773439e+06$ disk./.usageGB‚2975.984516143799 disk.dm-0.out‚ 68501.5625 disk.rbd2.in‚0 disk.rbd2.out‚ 1.341796875 disk.sdb1.in‚0 disk.sda1.in‚0 disk.rbd0.out‚ 1.404296875 disk.sda.in‚ 57.7890625 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.7890625 disk.md0.in‚ 67.2421875 disk.sdb.out‚ 631.728515625 network.sent‚ 1.0772789e+07 disk.dm-0.in‚ 253.32421875 disk.sda.out‚ 631.728515625 disk.sdb2.out‚ 631.728515625 disk.rbd0.in‚0$ memory_percent‚92.67284870147705) proc.memory.availableMB‚ 1200.48046875 disk.sdb1.out‚0* proc.memory.percent‚18.835806846618652 cpu‚25.772617913991773) disk./.usagePercent‚83.20977261766448 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875 disk.md0p1.out‚ 608.53515625 proc.cpu.threads‚17# disk.nvme0n1.out‚34996.91015625 disk.sdb.in‚9.453125Â$©qù‚(:æ ß±èÔܹު disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚68577.62890625 disk.sda.in‚ 57.7890625 disk.sda1.out‚0) proc.memory.availableMB‚ 1200.37890625! disk.sdb2.out‚633.78466796875 disk.md0p1.out‚ 610.53125 disk.rbd2.in‚0 disk.sda.out‚633.78466796875" disk.nvme1n1.out‚ 33511.3671875 disk.md0.in‚ 67.2421875* proc.memory.percent‚18.835806846618652 network.sent‚ 1.0777139e+07 disk.rbd0.in‚0 disk.rbd2.out‚ 1.341796875 disk.nvme0n1.in‚ 220.8671875 disk.sda2.in‚ 57.7890625 disk.md0.out‚ 610.53125$ memory_percent‚92.67346858978271 disk.md0p1.in‚ 67.2421875% disk./.usageGB‚2976.0594520568848 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.453125 cpu‚25.772034979180727 proc.cpu.threads‚17 network.recv‚ 1.778171e+06# disk.nvme0n1.out‚35066.26171875) disk./.usagePercent‚83.21186785715749 disk.rbd0.out‚ 1.404296875 disk.sdb.out‚633.78466796875! disk.sda2.out‚633.78466796875# proc.memory.rssMB‚ 3086.05859375 disk.sdb.in‚9.453125ÜANŸú‚(:” ß±èÔøÖ–« gpu.0.gpu‚68.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚234.448' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚58.611999999999995 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0<¼Dâ2û- _wandbruntime‚5469  _runtime‚5469ÍéHÝÉüà trainer/global_step‚4899 % _timestamp‚1.7884838170154061e+09 _runtime‚5469.125993976 _step‚396 ' lr-AdamW/pg1‚0.00012539258135795388 ' lr-AdamW/pg2‚0.00012539258135795388`ûÎýÈ ' lr-AdamW/pg2‚0.00012539258135795388 trainer/global_step‚4899 % _timestamp‚1.7884838170154061e+09 _runtime‚5469.125993976 _step‚396 ' lr-AdamW/pg1‚0.00012539258135795388Œ %ï=2þ- _wandbruntime‚5469  _runtime‚54692/Oøö'ÿðO YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚55299876 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚678444433079296 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚666921249489712 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚524 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚673059267922944 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884838170192509e+09 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5834045255168 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5385165156352 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 108686248 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚80859466 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚55299879 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚678444433079296 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 108709520 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚678443632563200 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚673059250883584 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚88827350 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚661554130390960 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 108686248 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5385165156352 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚88827348 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚88827348 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚661554147430320 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚673059267922944 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 197536870 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚80859993 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚578171555155968 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 _step‚397 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5366320577508 trainer/global_step‚4899 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚678443632563200 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚25559590 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚584005625314816 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 _runtime‚5469.129589933 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚25560114 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5384381679616 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚673059250883584 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚527 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5833889207808 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚666920450968468 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5367102059392 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 197513596 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0Ç`Tjû'€õO [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚578171555155968 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 _step‚397 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5366320577508 trainer/global_step‚4899 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚678443632563200 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚25559590 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚584005625314816 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 180951040 _runtime‚5469.129589933 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚25560114 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5384381679616 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚673059250883584 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚527 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5833889207808 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚666920450968468 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5367102059392 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 197513596 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚55299876 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚678444433079296 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚666921249489712 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚524 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚673059267922944 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 % _timestamp‚1.7884838170192509e+09 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5834045255168 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5385165156352 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 108686248 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚80859466 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚55299879 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚678444433079296 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 108709520 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚678443632563200 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚673059250883584 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚88827350 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚661554130390960 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 108686248 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5385165156352 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚88827348 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚88827348 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚661554147430320 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚673059267922944 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 197536870 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚80859993 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752h|Æ2- _wandbruntime‚5469  _runtime‚5469°…V»‚úM K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 108707936 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚678578250743296 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 197576036 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚578285698958848 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5835047845376 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚584120925644800 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 197552736 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚88844800 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 197552736 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 197576036 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚578285723862528 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚661684780592000 _runtime‚5469.961880388 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚88844802 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚88844800 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5835201782272 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚80875189 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚673192002195456 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5386231508480 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚55310639 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚25564553 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚661684797631360 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚673192019234816 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5385448018432 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 108731234 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚673192002195456 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚678577450213888 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5368164804926 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792Í—"'ƒÿM L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚88844802 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚88844800 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5835201782272 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚80875189 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚673192002195456 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5386231508480 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚55310639 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚25564553 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚661684797631360 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚673192019234816 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5385448018432 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 108731234 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚673192002195456 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚678577450213888 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5368164804926 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 108707936 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚678578250743296 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 197576036 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚578285698958848 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5835047845376 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚584120925644800 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 197552736 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚88844800 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 197552736 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 197576036 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚578285723862528 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚661684780592000 _runtime‚5469.961880388 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 P¼‘"“ðO GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5891902429696 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚673506923980020 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚89699950 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 199473948 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚89699948 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 199497222 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚673506125458776 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚679696816477184 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 109797272 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚81644932 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚685135343441920 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚589770672633344 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚401 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚89699950 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚685134542925824 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚522 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 % _timestamp‚1.7884838691135855e+09 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5438509925376 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5419485015816 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 trainer/global_step‚4949 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚589770487488000 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚583878745299968 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5891742188032 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚525 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚55837876 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5420266497700 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚679696833516544 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚668086640442960 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚685134542925824 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚679696833516544 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚81645457 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚679696816477184 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 _runtime‚5521.227853592 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 109774000 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚89699948 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚55837879 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664ú¤3û'”õO QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 109797272 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚81644932 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚685135343441920 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚589770672633344 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚401 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚89699950 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚685134542925824 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚522 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 % _timestamp‚1.7884838691135855e+09 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5438509925376 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5419485015816 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 trainer/global_step‚4949 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚589770487488000 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚583878745299968 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5891742188032 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚525 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚55837876 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5420266497700 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚679696833516544 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚668086640442960 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚685134542925824 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚679696833516544 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚81645457 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚679696816477184 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 _runtime‚5521.227853592 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 109774000 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚89699948 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚55837879 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5891902429696 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚673506923980020 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚89699950 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 199473948 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚89699948 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 199497222 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚673506125458776 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚679696816477184 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274‘"›Ë2•- _wandbruntime‚5522  _runtime‚5522èðGŽ'–úM I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5892904898048 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚589885972841472 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚583992889102848 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚685268360576512 trainer/global_step‚4949 _runtime‚5522.221023288 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚685269161105920 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚679829584828416 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚583992914006528 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚89717402 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚25811951 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5421329243234 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 199536388 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5438792787456 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5439576277504 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚81660587 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚526 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚529 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _step‚402 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 199513088 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚673638636926594 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5420547761142 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 199513088 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5438792787456 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚679829567789056 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5893058834944 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 109795688 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2rÕAÔ'—ÿM trainer/global_step‚4949 _runtime‚5522.221023288 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚685269161105920 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚679829584828416 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚583992914006528 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚89717402 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚25811951 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5421329243234 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 199536388 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5438792787456 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5439576277504 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚81660587 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚526 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚529 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 _step‚402 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 199513088 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚673638636926594 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5420547761142 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 199513088 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5438792787456 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚679829567789056 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 5893058834944 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 109795688 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 5892904898048 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚589885972841472 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚583992889102848 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚685268360576512’ oѵ2˜- _wandbruntime‚5522  _runtime‚5522©ð ™Ô /loss/FRt2/detection_loss‚1.9855094122212558 /loss/FBt2/detection_loss‚1.8547243766841435 1loss/FBt4/assignment_loss‚0.24049766446529036 1loss/SRqqt1/detection_loss‚0.9912427001805217 epoch‚8 trainer/global_step‚4949 2loss/SRqqt1/assignment_loss‚0.8974625795976156 0loss/SRqqt3/detection_loss‚2.080628060759642 /loss/FBt1/detection_loss‚0.7300654068159369 .loss/FRt1/detection_loss‚1.679428326795892 0loss/FRt2/assignment_loss‚1.8263083049229214 /loss/FRt4/assignment_loss‚3.131800573193625 .loss/FRt3/detection_loss‚2.896866576029704 /loss/FBt4/detection_loss‚3.3786412615042467 # _timestamp‚1.78848387011214e+09 0loss/FRt1/assignment_loss‚1.5148003142659028 /loss/FRt4/detection_loss‚2.1057618276930277 1loss/SRqqt4/detection_loss‚2.2180721090465294 /loss/FBt3/detection_loss‚2.1143724620342255 2loss/SRqqt2/assignment_loss‚1.0963102375479559 1loss/FBt1/assignment_loss‚0.07415301333184542 1loss/FBt2/assignment_loss‚0.0423872123096ƒÕm6T2434 0loss/FBt3/assignment_loss‚0.2685949993397492 _runtime‚5522.222213773 0loss/FRt3/assignment_loss‚2.7766813470767095 1loss/SRqqt2/detection_loss‚1.3154421123699882 %loss/total_loss‚38.31115232859593 1loss/SRqqt4/assignment_loss‚1.531145955390129 _step‚403 1loss/SRqqt3/assignment_loss‚1.560255495019448õà”£_šÙ 1loss/SRqqt3/assignment_loss‚1.560255495019448 /loss/FRt2/detection_loss‚1.9855094122212558 /loss/FBt2/detection_loss‚1.8547243766841435 1loss/FBt4/assignment_loss‚0.24049766446529036 1loss/SRqqt1/detection_loss‚0.9912427001805217 epoch‚8 trainer/global_step‚4949 2loss/SRqqt1/assignment_loss‚0.8974625795976156 0loss/SRqqt3/detection_loss‚2.080628060759642 /loss/FBt1/detection_loss‚0.7300654068159369 .loss/FRt1/detection_loss‚1.679428326795892 0loss/FRt2/assignment_loss‚1.8263083049229214 /loss/FRt4/assignment_loss‚3.131800573193625 .loss/FRt3/detection_loss‚2.896866576029704 /loss/FBt4/detection_loss‚3.3786412615042467 # _timestamp‚1.78848387011214e+09 0loss/FRt1/assignment_loss‚1.5148003142659028 /loss/FRt4/detection_loss‚2.1057618276930277 1loss/SRqqt4/detection_loss‚2.2180721090465294 /loss/FBt3/detection_loss‚2.1143724620342255 2loss/SRqqt2/assignment_loss‚1.0963102375479559 1loss/FBt1/assignment_loss‚0.07415301333184542 1loss/FBt2/assignment_loss‚0.04238721230962434 0loss/FBt3/assignment_loss‚0.2685949993397492 _runtime‚5522.222213773 0loss/FRt3/assignment_loss‚2.7766813470767095 1loss/SRqqt2/detection_loss‚1.3154421123699882 %loss/total_loss‚38.31115232859593 1loss/SRqqt4/assignment_loss‚1.531145955390129 _step‚403“¼ÝŠ.ž›‚(:“ ª²èÔÝ”î« gpu.0.gpu‚61.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚225.865' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚56.46625000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‰kG mœ‚(:â ª²èÔ–àì disk.sdb2.in‚9.453125 disk.md0.in‚ 67.2421875# memory_percent‚92.6762342453003 disk.sda1.in‚0" disk.nvme1n1.out‚ 34056.4453125 disk.sdb.in‚9.453125! disk.sdb2.out‚642.22998046875 network.recv‚ 1.799002e+06% disk./.usageGB‚2976.9929542541504 disk.sda.in‚ 57.7890625 disk.md0.out‚ 618.66015625 disk.rbd0.in‚0 disk.rbd2.in‚0" disk.nvme0n1.out‚ 35577.5546875 disk.dm-0.out‚69634 disk.sdb1.out‚0) proc.memory.availableMB‚ 1199.92578125 proc.cpu.threads‚17) disk./.usagePercent‚83.23796896929406 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.8671875 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚642.22998046875 disk.rbd0.out‚ 1.5576171875 cpu‚25.768310623752924 network.sent‚ 1.088659e+07! disk.sda2.out‚642.22998046875 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚ 618.66015625# proc.memory.rssMB‚ 3086.05859375 disk.rbd2.out‚ 1.5576171875 disk.sda.out‚642.22998046875 disk.sda2.in‚ 57.7890625* proc.memory.percent‚18.835806846618652 disk.dm-0.in‚ 253.32421875 disk.sdb1.in‚0_;zž‚(:“ ¹²èÔ†’˜ª gpu.0.gpu‚18.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0æ0þ†pž‚(:å ¹²èÔ½˜ˆ® network.recv‚ 1.805157e+06) disk./.usagePercent‚83.23913999527622 disk.rbd2.out‚ 1.5576171875 disk.sda.out‚643.99169921875 disk.sda1.out‚0 disk.sdb.in‚9.453125 disk.sdb.out‚643.99169921875! disk.sda2.out‚643.99169921875 disk.sda1.in‚0# proc.memory.rssMB‚ 3086.05859375 cpu‚25.767531040127135 disk.sdb1.out‚0 disk.nvme0n1.in‚ 220.8671875! disk.nvme0n1.out‚ 35620.578125 disk.sdb2.in‚9.453125 disk.sda2.in‚ 57.7890625 disk.dm-0.in‚ 253.32421875 disk.dm-0.out‚ 69781.15625 proc.cpu.threads‚17( proc.memory.availableMB‚ 1200.1171875* proc.memory.percent‚18.835806846618652 network.sent‚ 1.0973978e+07% disk./.usageGB‚2977.0348358154297 disk.sdb1.in‚0! disk.nvme1n1.out‚ 34160.578125! disk.sdb2.out‚643.99169921875 disk.md0p1.out‚ 620.3515625 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.2421875 disk.md0p1.in‚ 67.2421875 disk.rbd0.in‚0 disk.rbd0.out‚ 1.62060546875# memory_percent‚92.6750659942627 disk.rbd2.in‚0 disk.sda.in‚ 57.7890625 disk.md0.out‚ 620.3515625»¬ÉìuŸ‚(:ê ȲèÔã·µ«$ memory_percent‚92.67220497131348( proc.memory.availableMB‚ 1200.5859375* proc.memory.percent‚18.835806846618652) disk./.usagePercent‚83.23978038511108 disk.sda2.in‚ 57.7890625 disk.dm-0.in‚ 253.3671875 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.91015625 network.recv‚ 1.808973e+06 disk.rbd0.out‚ 1.62060546875 disk.rbd2.in‚0# disk.nvme0n1.out‚35621.13671875 proc.cpu.threads‚17 disk.sda2.out‚645.5478515625 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 621.84765625 disk.dm-0.out‚69994.40234375 disk.sdb1.out‚0! disk.nvme1n1.out‚ 34373.265625# proc.memory.rssMB‚ 3086.05859375 cpu‚25.766705820373627 network.sent‚ 1.0979214e+07 disk.sdb2.in‚9.453125 disk.md0p1.in‚ 67.2421875 disk.rbd0.in‚0 disk.sda.in‚ 57.7890625 disk.sda.out‚645.5478515625 disk.sdb.in‚9.453125 disk.sdb.out‚645.5478515625 disk.md0.out‚ 621.84765625 disk.rbd2.out‚ 1.62060546875 disk.nvme1n1.in‚ 32.45703125 disk.sda1.in‚0% disk./.usageGB‚2977.0577392578125 disk.sdb2.out‚645.5478515625 disk.sdb1.in‚0Ü4ºÉ” ‚(:‰ ɲèÔª¤Ÿl gpu.0.gpu‚81.0 gpu.0.memory‚20, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚131.173' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚32.79325 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Û7ë 2¡- _wandbruntime‚5573  _runtime‚5573,IU˜É¢Ã ' lr-AdamW/pg1‚0.00010501642541420537 ' lr-AdamW/pg2‚0.00010501642541420537 trainer/global_step‚4999 % _timestamp‚1.7884839213063698e+09 _runtime‚5573.419965775 _step‚404„v›Î£È _step‚404 ' lr-AdamW/pg1‚0.00010501642541420537 ' lr-AdamW/pg2‚0.00010501642541420537 trainer/global_step‚4999 % _timestamp‚1.7884839213063698e+09 _runtime‚5573.419965775”G®@Ô2¤- _wandbruntime‚5573  _runtime‚5573‘çCPö'¥ðO P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5491071217664 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚90572550 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 _step‚405 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚56375879 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚90572548 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚82432817 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚589585935443968 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚691825453288448 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5491854694400 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 _runtime‚5573.420994488 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 201434300 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚26056435 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚680091799949084 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚674619167534320 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚691825453288448 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚686334399110144 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5491854694400 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚691826253804544 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚680092598470328 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5949780794368 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚90572548 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5949932647424 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5473430936008 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 110885024 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚82432311 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 % _timestamp‚1.7884839213105145e+09 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚589585960347648 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚686334382070784 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚56375876 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚674619150494960 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚686334399110144 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 201457574 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5491071217664 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚686334382070784 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚595535892995072 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 trainer/global_step‚4999 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5472649454124 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244ðµ û'¦õO YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚686334382070784 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚56375876 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚674619150494960 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚686334399110144 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 201457574 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5491071217664 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚686334382070784 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚595535892995072 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 trainer/global_step‚4999 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚506 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5472649454124 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5491071217664 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚90572550 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 _step‚405 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚56375879 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚90572548 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚82432817 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚589585935443968 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚691825453288448 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5491854694400 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 _runtime‚5573.420994488 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 201434300 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚26056435 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚680091799949084 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚674619167534320 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚691825453288448 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚686334399110144 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5491854694400 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚691826253804544 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚680092598470328 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 5949780794368 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚90572548 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 5949932647424 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5473430936008 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 110885024 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚82432311 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 % _timestamp‚1.7884839213105145e+09 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚589585960347648 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0•êùá2§- _wandbruntime‚5574  _runtime‚5574}ñv¨úM % _timestamp‚1.7884839222396162e+09 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 _runtime‚5574.350381444 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚595651019451392 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚90590002 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚589700079246848 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 110906738 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚90590002 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _step‚406 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 110883440 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚509 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚691960071468544 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚26061829 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚90590000 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 110906738 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 201473440 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5492921046528 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚680223512895450 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 201473440 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚8&vfèc2447959 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚674749817735360 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚595651198291968 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚674749800696000 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚686467150422016 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 201496740 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚691959270939136 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚680224311416902 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0Ã6ºÄ'©ÿM RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚589700104150528 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚686467150422016 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚90590000 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5473712199450 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚686467133382656 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 _runtime‚5574.350381444 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚595651019451392 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚90590002 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚589700079246848 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 110906738 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚90590002 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _step‚406 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 110883440 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚509 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚691960071468544 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚26061829 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚506 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚90590000 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 110906738 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 201473440 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5492921046528 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚680223512895450 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 201473440 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚82447959 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚674749817735360 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚595651198291968 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚674749800696000 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚686467150422016 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 201496740 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚691959270939136 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚680224311416902 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 % _timestamp‚1.7884839222396162e+09 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 F!¹ïO M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 111949504 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 203417926 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚546 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5544415986688 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚543 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚595293150491648 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚56913879 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚56913876 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6007652233216 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚692971947664384 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 178853888 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚686678272960636 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 203394652 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚83219431 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _runtime‚5627.345043115 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 trainer/global_step‚5049 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚698516363651072 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6007498283008 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 111949504 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚681151660546960 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚698517164167168 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚692971964703744 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚409 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚595293125587968 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚692971947664384 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5545199463424 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚83219977 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚698517164167168 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚686677474439392 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5525813892432 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚698516363651072 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚91445148 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚601300802724864 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 111972776 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚26306098 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5526595374316 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚681151677586320 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚26305555 YIDe¦¨ù0·viceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 $ _timestamp‚1.788483975234647e+09 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚91445150 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚692971964703744 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚91445148 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5544415986688 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚595293125587968 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚692971947664384 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5545199463424 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚83219977 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚698517164167168 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚686677474439392 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5525813892432 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚698516363651072 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚91445148 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚601300802724864 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 111972776 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚26306098 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5526595374316 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚681151677586320 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚26305555 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 $ _timestamp‚1.788483975234647e+09 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚91445150 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚692971964703744 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚91445148 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5544415986688 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 111949504 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚681151660546960 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚698517164167168 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚692971964703744 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 _step‚409™Vü¸™2»- _wandbruntime‚5628  _runtime‚5628¢½™€'¼úM cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚595407294294528 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6008631703040 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚698650981831168 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5546265815552 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 203457092 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 203457092 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚91462602 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚601416092517376 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 111971192 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚83235108 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5546265815552 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚693104716015616 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚595407269390848 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚686809187385758 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚681282310748000 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 203433792 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 191423488 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 trainer/global_step‚5049 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5545482325504 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚56924636 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 111971192 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚693104698976256 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 166519808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 _runtime‚5628.365746725 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚91462602 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚693104698976256 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 111994490 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5526876637758 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 111994490 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚698650981831168 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5527658119850 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚56924639 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚91462600 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚686809985907210 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 203457092 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 203457092 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚91462602 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚601416092517376 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 111971192 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚83235108 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5546265815552 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚693104716015616 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚595407269390848 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚686809187385758 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚681282310748000 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 203433792 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 191423488 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 trainer/global_step‚5049 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5545482325504 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚56924636 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 111971192 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚693104698976256 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 166519808 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 _runtime‚5628.365746725 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚91462602 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚693104698976256 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 111994490 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5526876637758 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 111994490 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚698650981831168 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5527658119850 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚56924639 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚91462600 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚686809985907210 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 EDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5597760755712 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚92317750 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚705207274013696 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚699609513257984 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚601000315731968 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 113060528 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚705207274013696 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6065696065024 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚705208074529792 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚536 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚693263148929700 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚687684187638320 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5598544232448 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 113060528 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚601000340635648 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚57451879 $ _timestamp‚1.788484030827097e+09 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚92317750 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚533 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚699609513257984 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 205378278 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 113037256 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚92317748 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚699609530297344 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚84008682 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6065540017664 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚57451876 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚607066036700672 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚84008146 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚607065855749632 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5598544232448 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5597760755712 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚26556803 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚705207274013696 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6065696065024 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 156047360 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚705208074529792 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚536 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚693263148929700 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚687684187638320 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5598544232448 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 113060528 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚601000340635648 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚57451879 $ _timestamp‚1.788484030827097e+09 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚92317750 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚533 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚699609513257984 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 205378278 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 113037256 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚92317748 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚699609530297344 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚84008682 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6065540017664 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚57451876 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚607066036700672 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚84008146 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚607065855749632 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5598544232448 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5597760755712 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚26556803 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5597760755712 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚92317750 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚705207274013696 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚699609513257984 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚601000315731968 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309>©.ï2Í- _wandbruntime‚5683  _runtime‚5683㎡HVÎúM D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 205394144 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 _runtime‚5683.786266347 _step‚414 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 % _timestamp‚1.7884840316751297e+09 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 205417444 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚92335200 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 113082242 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚533 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚693395660397518 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚699742281609216 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 205417444 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 113058944 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚705341091664384 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚84024389 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚536 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6066853072896 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚607181337511424 S?DeviceStatsMonitor.on_train_batch_end/reqßr7ªuested_bytes.all.freed‚693394861876066 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5598827094528 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚57462636 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5580041076066 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 113058944 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚601114459534848 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚84023853 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5598827094528 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 205394144 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚92335202 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚687814820800000 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚92335202 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚699742264569856 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚705341892193792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚699742281609216 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 113082242 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚687814837839360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5580822558158 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚699742264569856 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5599610584576 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚26561750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚601114484438528 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 trainer/global_step‚5099 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚84023853 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5598827094528 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 205394144 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚92335202 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚687814820800000 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚92335202 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚699742264569856 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚705341892193792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚699742281609216 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 113082242 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚687814837839360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5580822558158 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚699742264569856 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5599610584576 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚26561750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚601114484438528 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 trainer/global_step‚5099 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 205417444 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚92335200 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 113082242 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚533 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚693395660397518 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚699742281609216 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 180937728 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 205417444 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 113058944 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚705341091664384 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚84024389 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚536 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6066853072896 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚607181337511424 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚693394861876066 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5598827094528 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚57462636 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5580041076066 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0žÁÝ 2Ð- _wandbruntime‚5683  _runtime‚5683@+¬XÑÒ /loss/FBt4/detection_loss‚2.6486682954587435 0loss/FRt2/assignment_loss‚1.7945410805940627 /loss/FRt3/assignment_loss‚3.065674087096905 0loss/FBt3/assignment_loss‚0.2510243325858994 .loss/FRt1/detection_loss‚1.519312929515855 0loss/SRqqt3/detection_loss‚2.337925616538886 .loss/FBt3/detection_loss‚2.479926250197671 2loss/SRqqt4/assignment_loss‚1.5576350834431514 1loss/FBt2/assignment_loss‚0.06865054648335053 -loss/FRt2/detection_loss‚1.89071253195405 /loss/FRt3/detection_loss‚2.9139520453995673 1loss/SRqqt2/detection_loss‚1.0905485543815387 1loss/SRqqt4/detection_loss‚2.5365612096381636 0loss/FBt4/assignment_loss‚0.4199628218939384 /loss/FRt4/detection_loss‚2.1666451478029005 trainer/global_step‚5099 0loss/SRqqt1/detection_loss‚0.960210587284886 epoch‚8 0loss/FRt1/assignment_loss‚1.4824135899543762 2loss/SRqqt1/assignment_loss‚0.9179108009458734 &loss/total_loss‚38.129859081287734 % _timestamp‚1.7884840316773043e+09 2loss/SRqqt2/assignment_loss‚1.1775824123336744 1loss/FBt1/assignment_loss‚0.11708290966980343 /loss/FRt4/assignment_loss‚3.051065430045128 1loss/SRqqt3/assignment_loss‚1.546145613220605 /loss/FBt1/detection_loss‚0.6710546097705844 .loss/FBt2/detection_loss‚1.464652595078123 _runtime‚5683.790859419 _step‚415º?1]Ò× 1loss/SRqqt4/detection_loss‚2.5365612096381636 0loss/FBt4/assignment_loss‚0.4199628218939384 /loss/FRt4/detection_loss‚2.1666451478029005 trainer/global_step‚5099 0loss/SRqqt1/detection_loss‚0.960210587284886 epoch‚8 0loss/FRt1/assignment_loss‚1.4824135899543762 2loss/SRqqt1/assignment_loss‚0.9179108009458734 &loss/total_loss‚38.129859081287734 % _timestamp‚1.7884840316773043e+09 2loss/SRqqt2/assignment_loss‚1.1775824123336744 1loss/FBt1/assignment_loss‚0.11708290966980343 /loss/FRt4/assignment_loss‚3.051065430045128 1loss/SRqqt3/assignment_loss‚1.546145613220605 /loss/FBt1/detection_loss‚0.6710546097705844 .loss/FBt2/detection_loss‚1.464652595078123 _runtime‚5683.790859419 _step‚415 /loss/FBt4/detection_loss‚2.6486682954587435 0loss/FRt2/assignment_loss‚1.7945410805940627 /loss/FRt3/assignment_loss‚3.065674087096905 0loss/FBt3/assignment_loss‚0.2510243325858994 .loss/FRt1/detection_loss‚1.519312929515855 0loss/SRqqt3/detection_loss‚2.337925616538886 .loss/FBt3/detection_loss‚2.479926250197671 2loss/SRqqt4/assignment_loss‚1.5576350834431514 1loss/FBt2/assignment_loss‚0.06865054648335053 -loss/FRt2/detection_loss‚1.89071253195405 /loss/FRt3/detection_loss‚2.9139520453995673 1loss/SRqqt2/detection_loss‚1.0905485543815387ŸägÜ“Ó‚(:ˆ À³èÔ¿Ìä¬ gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0)l-3mÔ‚(:â À³èÔ²ñ™­) disk./.usagePercent‚83.23984171491705 disk.sda2.in‚ 57.7890625 disk.rbd0.in‚0$ proc.memory.availableMB‚1199.875 proc.cpu.threads‚17 disk.sdb.in‚9.453125 disk.md0.in‚ 67.2421875 disk.md0.out‚ 636.3984375 disk.md0p1.out‚ 636.3984375 disk.rbd2.out‚ 1.68359375 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125% disk./.usageGB‚2977.0599327087402 disk.md0p1.in‚ 67.2421875 disk.sda.out‚660.56103515625 disk.sdb.out‚660.56103515625 disk.sdb2.in‚9.453125! disk.sda2.out‚660.56103515625 disk.dm-0.out‚ 71988.734375 disk.sda.in‚ 57.7890625 disk.sda1.out‚0# proc.memory.rssMB‚ 3086.05859375 network.sent‚ 1.1187003e+07 network.recv‚ 1.843729e+06 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.91015625# disk.nvme0n1.out‚35622.08203125 cpu‚25.762405995615666 disk.rbd2.in‚0$ memory_percent‚92.67654418945312! disk.sdb2.out‚660.56103515625# disk.nvme1n1.out‚36366.65234375* proc.memory.percent‚18.835806846618652 disk.rbd0.out‚ 1.68359375 disk.dm-0.in‚ 253.36718755ôê“Õ‚(:ˆ ϳèÔÛ³ž« gpu.0.gpu‚25.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚233.222' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚58.3055 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0LÏõQeÖ‚(:Ú ϳèÔÚÖõ« disk.dm-0.out‚ 72161.2265625& proc.memory.availableMB‚ 1199.59375 network.recv‚ 1.849271e+06 disk.sda1.in‚0" disk.nvme0n1.out‚ 35622.2109375 disk.sda2.in‚ 57.7890625 disk.rbd0.in‚0 disk.rbd2.out‚ 1.68359375* proc.memory.percent‚18.835806846618652 cpu‚25.76216768173345 disk.nvme0n1.in‚ 220.91015625 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.453125 network.sent‚ 1.1276189e+07 disk.sda.in‚ 57.7890625 disk.sdb.in‚9.453125 disk.sdb.out‚662.2373046875 disk.sda2.out‚662.2373046875 disk.md0.out‚ 638.0078125 disk.rbd0.out‚ 1.68359375# proc.memory.rssMB‚ 3086.05859375 disk.sda.out‚662.2373046875! disk.nvme1n1.out‚ 36539.015625 disk.sdb2.out‚662.2373046875 disk.sda1.out‚0 disk.md0p1.out‚ 638.0078125 proc.cpu.threads‚17 disk.md0p1.in‚ 67.2421875 disk.dm-0.in‚ 253.3671875 disk.rbd2.in‚0$ memory_percent‚92.67826080322266% disk./.usageGB‚2976.1233444213867 disk.sdb1.in‚0 disk.sdb1.out‚0& disk./.usagePercent‚83.21365431441 disk.md0.in‚ 67.2421875›R½”ׂ(:‰ Þ³èÔ†ÙÅ« gpu.0.gpu‚62.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚223.918' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.9795 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0šçòpØ‚(:å Þ³èÔüô÷«* proc.memory.percent‚18.835806846618652 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125" disk.nvme1n1.out‚ 36691.5390625 disk.dm-0.in‚ 253.3671875 disk.sda.out‚663.74365234375 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.91015625 disk.md0.out‚ 639.46484375 disk.rbd0.in‚0 proc.cpu.threads‚17 network.recv‚ 1.852989e+06$ disk./.usageGB‚2976.248119354248 disk.sdb1.in‚0 disk.sdb.in‚9.453125 disk.md0p1.out‚ 639.46484375# proc.memory.rssMB‚ 3086.05859375 network.sent‚ 1.1279111e+07 disk.sdb2.in‚9.453125$ memory_percent‚92.67442226409912 disk.sda.in‚ 57.7890625 disk.sdb.out‚663.74365234375 disk.sda2.in‚ 57.7890625 cpu‚25.76183149249252 disk.rbd0.out‚ 1.68359375 disk.sda1.in‚0" disk.nvme0n1.out‚ 35622.2578125! disk.sdb2.out‚663.74365234375 disk.md0p1.in‚ 67.2421875 disk.rbd2.out‚ 1.68359375) proc.memory.availableMB‚ 1200.22265625) disk./.usagePercent‚83.21714307375517! disk.sda2.out‚663.74365234375 disk.rbd2.in‚0 disk.md0.in‚ 67.2421875 disk.dm-0.out‚ 72313.796875kÇŽ’Ù‚(:‡ í³èÔÉþÞ« gpu.0.gpu‚12.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚216.456' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.114 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ß„¨wqÚ‚(:æ í³èÔ×À™¬ disk.sdb1.out‚0 disk.sda.in‚ 57.7890625 disk.sda1.out‚0 disk.sdb.in‚9.453125 disk.nvme0n1.in‚ 220.91015625! disk.nvme1n1.out‚ 36818.953125 disk.sdb2.in‚9.453125 disk.md0.out‚ 641.48828125 disk.md0p1.out‚ 641.48828125 disk.dm-0.out‚72441.32421875 disk.sda.out‚665.83056640625# disk.nvme0n1.out‚35622.37109375 disk.md0p1.in‚ 67.2421875 disk.dm-0.in‚ 253.3671875$ memory_percent‚92.67630577087402 disk.sda1.in‚0 disk.rbd0.out‚ 1.68359375 disk.rbd2.out‚ 1.68359375 disk.md0.in‚ 67.2421875 network.sent‚ 1.1287925e+07 disk.sdb.out‚665.83056640625) disk./.usagePercent‚83.21714350039728 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.in‚0 proc.cpu.threads‚17 disk.rbd2.in‚0$ disk./.usageGB‚2976.248134613037! disk.sdb2.out‚665.83056640625 disk.sda2.in‚ 57.7890625( proc.memory.availableMB‚ 1199.9140625# proc.memory.rssMB‚ 3086.05859375* proc.memory.percent‚18.835806846618652 cpu‚25.761538154685603! disk.sda2.out‚665.83056640625 network.recv‚ 1.85774e+06 disk.sdb1.in‚0rÛñ2Û- _wandbruntime‚5730  _runtime‚5730Èù£JÇÜÁ & lr-AdamW/pg2‚7.755907894594296e-05 trainer/global_step‚5149 % _timestamp‚1.7884840786291664e+09 _runtime‚5730.739462346 _step‚416 & lr-AdamW/pg1‚7.755907894594296e-05z?áMÌÝÆ _runtime‚5730.739462346 _step‚416 & lr-AdamW/pg1‚7.755907894594296e-05 & lr-AdamW/pg2‚7.755907894594296e-05 trainer/global_step‚5149 % _timestamp‚1.7884840786291664e+09 îBZ 2Þ- _wandbruntime‚5730  _runtime‚5730ôÈŸUößðO P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5651889001472 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚694216680650960 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚706247095890944 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚706247078851584 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚612831130205184 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚711898184376320 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚706247095890944 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚93190348 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚84798399 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚6998496¡$ç€21941252 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚706247078851584 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5651105524736 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5632924250932 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 207338630 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 114148280 _runtime‚5730.740741092 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚26807965 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚555 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785]ÞáÆû'àõO ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5651889001472 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚694216680650960 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚706247095890944 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚706247078851584 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚612831130205184 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚711898184376320 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚706247095890944 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚93190348 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚84798399 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚699849621941252 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚706247078851584 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5651105524736 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5632924250932 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 207338630 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 114148280 _runtime‚5730.740741092 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚26807965 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚555 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400¡‡{2á- _wandbruntime‚5731  _runtime‚5731=º©'âúM RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5652955353600 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚712032802556416 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6124584387584 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 207354496 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚84814138 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5633205514374 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚706379847202816 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚699980536366374 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚712032002027008 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚58000639 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _step‚418 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚706379830163456 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚547 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚26813499 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚26812955 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 207377796 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 114146696 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 114146696 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚58000636 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚706379830163456 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6124744615936 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚706379847202816 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚93207802 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 trainer/global_step‚5149 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚84813591 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚606821674582528 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚712032802556416 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚93207800 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚694347330852000 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 207377796 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚93207800 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 114169994 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚612946419198464 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 207354496 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚699981334887826 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 % _timestamp‚1.7884840796923945e+09 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚694347347891360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5633986996466 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚93207802 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5652171863552 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5652171863552 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚544 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185132032 _runtime‚5731.803690311¢BŽ'ãÿM K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚706379830163456 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚547 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚26813499 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚26812955 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 PDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 207377796 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 114146696 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 114146696 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚58000636 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚706379830163456 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6124744615936 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚706379847202816 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚93207802 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 trainer/global_step‚5149 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚84813591 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚606821674582528 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚712032802556416 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚93207800 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚694347330852000 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 207377796 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚93207800 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 114169994 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚612946419198464 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 207354496 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚699981334887826 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 % _timestamp‚1.7884840796923945e+09 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚694347347891360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5633986996466 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚93207802 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5652171863552 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5652171863552 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚544 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185132032 _runtime‚5731.803690311 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5652955353600 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚712032802556416 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6124584387584 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 207354496 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚84814138 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5633205514374 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚706379847202816 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚699980536366374 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚712032002027008 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚58000639 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _step‚418¢­¤2ä- _wandbruntime‚5731  _runtime‚5731Kþ‚ÚkåÐ %loss/total_loss‚37.83250309327336 1loss/SRqqt4/assignment_loss‚1.485947933526371 1loss/FBt4/assignment_loss‚0.06068418160940122 /loss/FRt4/detection_loss‚2.0393261831626726 epoch‚8 trainer/global_step‚5149 2loss/SRqqt2/assignment_loss‚1.0763370842706956 _step‚419 1loss/SRqqt3/assignment_loss‚1.788852419163431 /lo›¨®ëss/FRt3/detection_loss‚2.8795131798517906 $ _timestamp‚1.788484079695063e+09 2loss/SRqqt1/assignment_loss‚0.7176200566763962 1loss/FBt2/assignment_loss‚0.04824546031512492 /loss/FRt2/assignment_loss‚1.786822935648724 0loss/FBt3/assignment_loss‚0.3224072144276501 /loss/FRt4/assignment_loss‚3.074069115298766 .loss/FRt2/detection_loss‚1.750535258215613 1loss/SRqqt2/detection_loss‚1.3020052002606595 /loss/FBt1/detection_loss‚0.7279839861079884 /loss/FBt3/detection_loss‚2.5811398263488496 _runtime‚ 5731.80545507 0loss/FRt3/assignment_loss‚3.1854522329265786 1loss/FBt1/assignment_loss‚0.07143751112134764 0loss/SRqqt1/detection_loss‚1.150264539177332 .loss/FBt4/detection_loss‚2.865246985639845 /loss/FRt1/assignment_loss‚1.356515872863031 /loss/FRt1/detection_loss‚1.6682946875050504 1loss/SRqqt3/detection_loss‚2.2761895123027984 1loss/SRqqt4/detection_loss‚2.1503854036331176 -loss/FBt2/detection_loss‚1.46722631322013©iÝ[æÕ 1loss/SRqqt3/assignment_loss‚1.788852419163431 /loss/FRt3/detection_loss‚2.8795131798517906 $ _timestamp‚1.788484079695063e+09 2loss/SRqqt1/assignment_loss‚0.7176200566763962 1loss/FBt2/assignment_loss‚0.04824546031512492 /loss/FRt2/assignment_loss‚1.786822935648724 0loss/FBt3/assignment_loss‚0.3224072144276501 /loss/FRt4/assignment_loss‚3.074069115298766 .loss/FRt2/detection_loss‚1.750535258215613 1loss/SRqqt2/detection_loss‚1.3020052002606595 /loss/FBt1/detection_loss‚0.7279839861079884 /loss/FBt3/detection_loss‚2.5811398263488496 _runtime‚ 5731.80545507 0loss/FRt3/assignment_loss‚3.1854522329265786 1loss/FBt1/assignment_loss‚0.07143751112134764 0loss/SRqqt1/detection_loss‚1.150264539177332 .loss/FBt4/detection_loss‚2.865246985639845 /loss/FRt1/assignment_loss‚1.356515872863031 /loss/FRt1/detection_loss‚1.6682946875050504 1loss/SRqqt3/detection_loss‚2.2761895123027984 1loss/SRqqt4/detection_loss‚2.1503854036331176 -loss/FBt2/detection_loss‚1.46722631322013 %loss/total_loss‚37.83250309327336 1loss/SRqqt4/assignment_loss‚1.485947933526371 1loss/FBt4/assignment_loss‚0.06068418160940122 /loss/FRt4/detection_loss‚2.0393261831626726 epoch‚8 trainer/global_step‚5149 2loss/SRqqt2/assignment_loss‚1.0763370842706956 _step‚419£Ñ<|î•ç‚(:Š ü³èÔÛïî« gpu.0.gpu‚74.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚226.473' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.61825 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0JX›\è‚(:Ñ ü³èÔËÙ¬ disk.rbd2.out‚ 1.68359375 disk.sda.in‚ 57.7890625 proc.cpu.threads‚17 network.sent‚ 1.1290955e+07! disk.sda2.out‚667.39697265625 disk.rbd0.in‚0 disk.sda.out‚667.39697265625 disk.sda2.in‚ 57.7890625 disk.md0p1.in‚ 67.2421875 disk.dm-0.in‚ 253.3671875$ memory_percent‚92.67656803131104) proc.memory.availableMB‚ 1199.87109375 network.recv‚ 1.861322e+06% disk./.usageGB‚2976.1229095458984 disk.md0.out‚643 disk.dm-0.out‚72620.92578125 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sda1.in‚0 disk.rbd0.out‚ 1.68359375 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.453125! disk.sdb2.out‚667.39697265625* proc.memory.percent‚18.835806846618652 cpu‚25.76072523299957 disk.md0.in‚ 67.2421875 disk.sda1.out‚0 disk.sdb.in‚9.453125) disk./.usagePercent‚83.21364215510933 disk.md0p1.out‚643# disk.nvme0n1.out‚35622.42578125 disk.nvme0n1.in‚ 220.91015625 disk.nvme1n1.out‚36998.5 disk.sdb.out‚667.39697265625# proc.memory.rssMB‚ 3086.05859375.œö›é‚(: ‹´èÔÜî“« gpu.0.gpu‚13.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚236.1' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚59.02499999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¸‹c´oê‚(:ä ‹´èÔ“Üé« disk.sdb.in‚9.453125 disk.sdb1.out‚0# memory_percent‚92.6781177520752 cpu‚25.760101833262446 disk.sda.in‚ 57.7890625 disk.sda.out‚669.07861328125# disk.nvme1n1.out‚37042.01953125 disk.md0.in‚ 67.2421875 disk.dm-0.out‚72664.91796875 disk.sdb1.in‚0( proc.memory.availableMB‚ 1199.6171875 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚ 644.609375# proc.memory.rssMB‚ 3086.05859375* proc.memory.percent‚18.835806846618652 disk.rbd0.out‚ 1.68359375 network.sent‚ 1.1378102e+07 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚669.07861328125 disk.md0.out‚ 644.609375 disk.dm-0.in‚ 253.3671875 disk.rbd2.in‚0 disk.sdb.out‚669.07861328125) disk./.usagePercent‚83.20595491723826! disk.sda2.out‚669.07861328125% disk./.usageGB‚2975.8479766845703 disk.sdb2.in‚9.453125 disk.rbd2.out‚ 1.68359375 proc.cpu.threads‚17 network.recv‚ 1.866817e+06 disk.sda1.in‚0 disk.sda1.out‚0" disk.nvme0n1.out‚ 35622.8984375 disk.sda2.in‚ 57.7890625 disk.rbd0.in‚0 disk.nvme0n1.in‚ 220.910156256°lŸë‚(:” š´èÔÑ€ª gpu.0.gpu‚73.0 gpu.0.memory‚17, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚214.281' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚53.570249999999994 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0{86kkì‚(:à š´èÔ·˜åª$ proc.memory.availableMB‚1199.375 disk.sdb.out‚671.0947265625 disk.sda2.out‚671.0947265625 disk.dm-0.out‚72745.05078125$ memory_percent‚92.67959594726562$ disk./.usageGB‚2975.959300994873" disk.nvme1n1.out‚ 37042.6484375 disk.rbd2.in‚0 cpu‚25.759396970175843 proc.cpu.threads‚17 disk.sda.out‚671.0947265625 disk.sdb.in‚9.453125 disk.sda2.in‚ 57.7890625 disk.dm-0.in‚ 253.3671875* proc.memory.percent‚18.835806846618652 disk.sda.in‚ 57.7890625# disk.nvme0n1.out‚35702.40234375 disk.md0.out‚ 646.57421875 disk.md0p1.in‚ 67.2421875 disk.sdb2.out‚671.0947265625 network.recv‚ 1.870684e+06) disk./.usagePercent‚83.20906759154715 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.out‚ 646.57421875 disk.rbd0.in‚0# proc.memory.rssMB‚ 3086.05859375 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.91015625 disk.md0.in‚ 67.2421875 disk.sdb1.out‚0 network.sent‚ 1.1383215e+07 disk.sda1.in‚0 disk.sdb2.in‚9.453125 disk.rbd0.out‚ 1.68359375 disk.rbd2.out‚ 1.68359375 disk.sdb1.in‚0j%2í- _wandbruntime‚5780  _runtime‚5780r{ :ÇîÁ & lr-AdamW/pg2‚6.926604997440378e-05 trainer/global_step‚5199 % _timestamp‚1.7884841279944375e+09 _runtime‚5780.104766383 _step‚420 & lr-AdamW/pg1‚6.926604997440378e-05ø¦ãÌïÆ _step‚420 & lr-AdamW/pg1‚6.926604997440378e-05 & lr-AdamW/pg2‚6.926604997440378e-05 trainer/global_step‚5199 % _timestamp‚1.7884841279944375e+09 _runtime‚5780.104766383¤ý-™Ã2ð- _wandbruntime‚5780  _runtime‚5780®¹ö'ñðO KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚85588151 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚612414696019968 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚718589895255040 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚27059744 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚712884661484544 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5704450293760 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 209275708 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚94062948 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 _step‚421 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚718589895255040 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6181179593728 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚85587620 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚618595875613696 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6181339835392 trainer/global_step‚5199 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚718589094738944 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _runtime‚5780.105500557 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚712884644445184 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5704450293760 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚718589094738944 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5705233770496 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 115212760 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚58527876 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚531 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 209298982 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚706435296431560 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚712884661484544 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 % _timestamp‚1.7884841279951706e+09 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 115236032 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _runtime‚5780.105500557 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚712884644445184 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5704450293760 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚718589094738944 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5705233770496 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 115212760 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚58527876 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚531 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 209298982 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚706435296431560 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚712884661484544 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 % _timestamp‚1.7884841279951706e+09 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 115236032 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚94062948 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009¥‰Z‰2ó- _wandbruntime‚5780  _runtime‚5780<ÍVà+ôùM E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 115257746 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚58538636 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 209338148 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚612528864726528 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5705516632576 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 209314848 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚718723712919040 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5706300122624 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚422 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚706566210856682 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚718722912389632 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6182484657664 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚612528839822848 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5687151434774 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 115234448 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚713017412796416 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 115257746 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚532 K>DeviceStatsMonitor.on_train_u<}Ôbatch_end/inactive_split.all.freed‚85603296 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚529 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _runtime‚5780.952528492 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5706300122624 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 209338148 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27064660 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚706567009378134 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚94080402 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚94080400 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 trainer/global_step‚5199 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 _runtime‚5780.952528492 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5706300122624 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 209338148 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27064660 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚706567009378134 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚94080402 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚94080400 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 trainer/global_step‚5199 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 209338148 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚612528864726528 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5705516632576 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 209314848 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚718723712919040 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5706300122624 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 _step‚422 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚706566210856682 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚718722912389632 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6182484657664 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚612528839822848 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5687151434774 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 115234448 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚713017412796416 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 115257746 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚532 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚85603296 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚529 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792¦ëV2ö- _wandbruntime‚5780  _runtime‚5780I¥6—^÷Ø 2loss/SRqqt2/assignment_loss‚1.2009554881071427 /loss/FRt2/detection_loss‚1.9336537277216421 /loss/FBt4/detection_loss‚2.1815535681588307 0loss/FRt1/assignment_loss‚1.6637187670258915 2loss/SRqqt4/assignment_loss‚1.7498640219370525 1loss/SRqqt2/detection_loss‚1.1625469395115693 epoch‚8 2loss/SRqqt1/assignment_loss‚0.9487459155776813 2loss/FBt2/assignment_loss‚0.053884815544790854 0loss/FBt4/assignment_loss‚0.1448499533435584 0loss/SRqqt4/detection_loss‚2.632422626018524 /loss/FBt2/detection_loss‚1.4594498216839773 .loss/FBt3/detection_loss‚3.018109055665823 $ _timestamp‚1.788484128844563e+09 0loss/SRqqt3/detection_loss‚2.500093094431437 /loss/FBt1/detection_loss‚0.6160621098115989 0loss/FRt4/assignment_loss‚3.0459285229444504 1loss/FBt3/assignment_loss‚0.18342171354793033 /loss/FRt3/detection_loss‚2.8832068876786665 .loss/FRt4/detection_loss‚2.015773352177348 trainer/global_step‚5199 _step‚423 1loss/SRqqt1/detection_loss‚0.8908604438823293 %loss/total_loss‚39.27206704665522 _runtime‚5780.954608133 0loss/FRt3/assignment_loss‚3.7675823428414086 2loss/SRqqt3/assignment_loss‚1.5653796568512917 1loss/FBt1/assignment_loss‚0.06781095331466006 /loss/FRt1/detection_loss‚1.8844111667836414 0loss/FRt2/assignment_loss‚1.7017821020939772?½‚¥cøÝ /loss/FRt3/detection_loss‚2.8832068876786665 .loss/FRt4/detection_loss‚2.015773352177348 trainer/global_step‚5199 _step‚423 1loss/SRqqt1/detection_loss‚0.8908604438823293 %loss/total_loss‚39.27206704665522 _runtime‚5780.954608133 0loss/FRt3/assignment_loss‚3.7675823428414086 2loss/SRqqt3/assignment_loss‚1.5653796568512917 1loss/FBt1/assignment_loss‚0.06781095331466006 /loss/FRt1/detection_loss‚1.8844111667836414 0loss/FRt2/assignment_loss‚1.7017821020939772 2loss/SRqqt2/assignment_loss‚1.2009554881071427 /loss/FRt2/detection_loss‚1.9336537277216421 /loss/FBt4/detection_loss‚2.1815535681588307 0loss/FRt1/assignment_loss‚1.6637187670258915 2loss/SRqqt4/assignment_loss‚1.7498640219370525 1loss/SRqqt2/detection_loss‚1.1625469395115693 epoch‚8 2loss/SRqqt1/assignment_loss‚0.9487459155776813 2loss/FBt2/assignment_loss‚0.053884815544790854 0loss/FBt4/assignment_loss‚0.1448499533435584 0loss/SRqqt4/detection_loss‚2.632422626018524 /loss/FBt2/detection_loss‚1.4594498216839773 .loss/FBt3/detection_loss‚3.018109055665823 $ _timestamp‚1.788484128844563e+09 0loss/SRqqt3/detection_loss‚2.500093094431437 /loss/FBt1/detection_loss‚0.6160621098115989 0loss/FRt4/assignment_loss‚3.0459285229444504 1loss/FBt3/assignment_loss‚0.18342171354793033§G‰”•ù‚(:Š ©´èÔ«±¼ª gpu.0.gpu‚61.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚206.203' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.55075 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚07ôdFdú‚(:Ù ©´èÔ‘öÄ«* proc.memory.percent‚18.835806846618652$ disk./.usageGB‚2976.029037475586 disk.sdb2.in‚9.453125 disk.rbd0.in‚0 disk.rbd0.out‚ 1.68359375# proc.memory.rssMB‚ 3086.05859375 cpu‚25.758765144249267 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚37042.82421875 network.recv‚ 1.875564e+06# disk.nvme0n1.out‚35850.58984375 disk.dm-0.out‚ 72893.4140625 disk.sda.in‚ 57.7890625 disk.nvme0n1.in‚ 220.91015625 disk.sdb2.out‚ 672.75390625 disk.sda2.in‚ 57.7890625) disk./.usagePercent‚83.21101745273488 disk.sdb1.in‚0 disk.sda.out‚ 672.75390625 disk.sda1.in‚0 disk.md0p1.in‚ 67.2421875 disk.dm-0.in‚ 253.3671875 disk.rbd2.in‚0) proc.memory.availableMB‚ 1199.58203125 disk.sda2.out‚ 672.75390625 disk.rbd2.out‚ 1.68359375$ memory_percent‚92.67833232879639 proc.cpu.threads‚17 network.sent‚ 1.1402824e+07 disk.sda1.out‚0 disk.sdb.out‚ 672.75390625 disk.sdb1.out‚0 disk.sdb.in‚9.453125 disk.md0.out‚ 648.171875 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 648.171875ThÖ­”û‚(:‰ ¸´èÔò¯„« gpu.0.gpu‚12.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚192.277' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚48.06925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚05dÐjü‚(:ß ¸´èÔçÜ÷« disk.sdb2.in‚9.453125 disk.rbd2.out‚ 1.68359375 disk.sda1.out‚0# proc.memory.rssMB‚ 3086.05859375* proc.memory.percent‚18.835806846618652 disk.sdb.in‚9.453125 disk.sda2.in‚ 57.7890625 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.out‚ 1.68359375 proc.cpu.threads‚17 disk.md0p1.in‚ 67.2421875 disk.dm-0.out‚72946.66796875 disk.sdb1.out‚0) disk./.usagePercent‚83.21451485158316$ disk./.usageGB‚2976.154121398926 disk.sdb1.in‚0 disk.sda.out‚674.08740234375$ memory_percent‚92.67830848693848 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.91015625 disk.sdb.out‚674.08740234375! disk.sdb2.out‚674.08740234375! disk.sda2.out‚674.08740234375 disk.md0.out‚649.4375 disk.md0p1.out‚649.4375# disk.nvme0n1.out‚35903.69140625 disk.dm-0.in‚ 253.3671875 cpu‚25.75813977705913 network.sent‚ 1.1475919e+07" disk.nvme1n1.out‚ 37042.9765625 disk.md0.in‚ 67.2421875 disk.sda.in‚ 57.7890625 disk.sda1.in‚0( proc.memory.availableMB‚ 1199.5859375 network.recv‚ 1.880023e+06^X¸ý‚(:’ Ç´èÔµÒ™« gpu.0.gpu‚2.0 gpu.0.memory‚1, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0‚±Neþ‚(:Ú Ç´èÔè÷ž¬% disk./.usageGB‚2976.2838439941406 disk.sda1.out‚0 disk.sda2.in‚ 57.7890625& proc.memory.availableMB‚ 1199.09375* proc.memory.percent‚18.835806846618652 network.recv‚ 1.884859e+06 disk.rbd2.out‚ 1.68359375 disk.sda1.in‚0# disk.nvme1n1.out‚37043.51171875 disk.md0.out‚ 651.2109375 disk.dm-0.in‚ 253.3671875 disk.sdb1.out‚0 disk.sdb2.in‚9.453125 disk.rbd0.out‚ 1.68359375# proc.memory.rssMB‚ 3086.05859375 cpu‚25.75743312137508 disk.sda.in‚ 57.7890625 disk.sda.out‚ 675.923828125 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚ 675.923828125 disk.dm-0.out‚73105.04296875 disk.nvme0n1.out‚ 36061.53125 disk.sdb2.out‚ 675.923828125 proc.cpu.threads‚17 disk.sdb1.in‚0 disk.sdb.in‚9.453125 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚ 651.2109375 disk.rbd0.in‚0$ memory_percent‚92.68131256103516 disk.md0.in‚ 67.2421875) disk./.usagePercent‚83.21814194963848 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.91015625 disk.sda2.out‚ 675.923828125 network.sent‚ 1.1484763e+07Kj$2ÿ- _wandbruntime‚5833  _runtime‚5833½S}ÓÇ€Á trainer/global_step‚5249 % _timestamp‚1.7884841812560115e+09 _runtime‚5833.366381424 _step‚424 & lr-AdamW/pg1‚6.141457249739383e-05 & lr-AdamW/pg2‚6.141457249739383e-05ƒ„ăÌÆ _step‚424 & lr-AdamW/pg1‚6.141457249739383e-05 & lr-AdamW/pg2‚6.141457249739383e-05 trainer/global_step‚5249 % _timestamp‚1.7884841812560115e+09 _runtime‚5833.366381424¨›¡2‚- _wandbruntime‚5833  _runtime‚5833[ßRÕ$ƒðO ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5758578539520 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚707281700754960 _step‚425 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚719522227078144 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6239054465536 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚725280005101568 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚94935548 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚94935550 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚94935548 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚719522210038784 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 187242496 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚725280805617664 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚618121911067648 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚707281717794320 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚624360940629504 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚525 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5738471645664 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚618121886163968 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 116300512 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 211259334 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 211236060 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5758578539520 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚713020172400624 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 162338816 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 116300512 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚86377048 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5757795062784 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚86376523 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚719522210038784 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 % _timestamp‚1.7884841812576592e+09 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚59065879 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚725280805617664 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚522 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6239216804352 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 116323784 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚719522227078144 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5757795062784 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocatŠ"ÛJ!ed‚94935550 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚713020970921868 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚725280005101568 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚86376523 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚719522210038784 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 % _timestamp‚1.7884841812576592e+09 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚59065879 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚725280805617664 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚522 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6239216804352 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 116323784 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚719522227078144 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5757795062784 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚94935550 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚713020970921868 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚725280005101568 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚725280005101568 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚94935548 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚94935550 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚94935548 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚719522210038784 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 187242496 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚725280805617664 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚618121911067648 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚707281717794320 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚624360940629504 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚525 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5738471645664 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚618121886163968 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0©FiZÄ2…- _wandbruntime‚5834  _runtime‚5834hÓm’'†úM ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚707412350956000 trainer/global_step‚5249 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚27316145 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 116322200 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6240212138496 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 211298500 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 116322200 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚528 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5758861401600 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚719654961350656 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5759644891648 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5758861401600 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27315617 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚725413822752256 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚531 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 116345498 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚713152683868442 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚719654978390016 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚86392784 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚59076636 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚618236054870528 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚719654978390016 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚719654961350656 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 211298500 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚94953002 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚94953000 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚725414623281664 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 211275200 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 116345498 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚713151885346990 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚86392253 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚707412367995360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0bno'‡ÿM ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚719654961350656 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 211298500 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚94953002 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚94953000 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚725414623281664 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 211275200 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 116345498 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚713151885346990 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚86392253 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚707412367995360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚707412350956000 trainer/global_step‚5249 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚27316145 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 116322200 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6240212138496 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 211298500 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 116322200 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚528 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5758861401600 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚719654961350656 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5759644891648 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5758861401600 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27315617 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚725413822752256 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚531 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 116345498 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚713152683868442 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚719654978390016 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚86392784 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚59076636 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚618236054870528 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚719654978390016 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0ªÄº2ˆ- _wandbruntime‚5834  _runtime‚5834`S]‰× 0loss/FRt3/assignment_loss‚2.4881515233021863 2loss/SRqqt1/assignment_loss‚0.9755571149927736 2loss/SRqqt3/assignment_loss‚1.3615585927103386 2loss/SRqqt4/assignment_loss‚1.5373940298884687 1loss/FBt1/assignment_loss‚0.07504680187482425 1loss/FBt4/assignment_loss‚0.07885583865152931 /loss/FRt1/detection_loss‚1.7736456796199411 .loss/FRt2/detection_loss‚1.857831446453929 0loss/FRt2/assignment_loss‚1.9964700135317717 .loss/FRt4/detection_loss‚1.995949756224928 1loss/SRqqt2/detection_loss‚1.3039819422237418 /loss/FBt2/detection_loss‚1.4753753021359444 epoch‚8 _runtime‚5834.353904678 _step‚427 % _timestamp‚1.7884841822438257e+09 0loss/FRt4/assignment_loss‚2.9723463592075166 /loss/FBt1/detection_loss‚0.6750845176890701 -loss/FBt3/detection_loss‚2.90563679933548 %loss/total_loss‚37.80158320410087 0loss/FBt3/assignment_loss‚0.1319224581303312 1loss/SRqqt3/detection_loss‚2.4749903932946626 trainer/global_step‚5249 /loss/FRt3/detection_loss‚2.9004779244368932 0loss/FRt1/assignment_loss‚1.5759723396091672 1loss/SRqqt1/detection_loss‚0.9603148019700138 2loss/SRqqt2/assignment_loss‚1.0785395067039851 1loss/FBt2/assignment_loss‚0.04524534717497317 0loss/SRqqt4/detection_loss‚2.199096525219125 /loss/FBt4/detection_loss‚2.96213818971927366ðJÃæŠÜ trainer/global_step‚5249 /loss/FRt3/detection_loss‚2.9004779244368932 0loss/FRt1/assignment_loss‚1.5759723396091672 1loss/SRqqt1/detection_loss‚0.9603148019700138 2loss/SRqqt2/assignment_loss‚1.07853950|67039851 1loss/FBt2/assignment_loss‚0.04524534717497317 0loss/SRqqt4/detection_loss‚2.199096525219125 /loss/FBt4/detection_loss‚2.9621381897192736 0loss/FRt3/assignment_loss‚2.4881515233021863 2loss/SRqqt1/assignment_loss‚0.9755571149927736 2loss/SRqqt3/assignment_loss‚1.3615585927103386 2loss/SRqqt4/assignment_loss‚1.5373940298884687 1loss/FBt1/assignment_loss‚0.07504680187482425 1loss/FBt4/assignment_loss‚0.07885583865152931 /loss/FRt1/detection_loss‚1.7736456796199411 .loss/FRt2/detection_loss‚1.857831446453929 0loss/FRt2/assignment_loss‚1.9964700135317717 .loss/FRt4/detection_loss‚1.995949756224928 1loss/SRqqt2/detection_loss‚1.3039819422237418 /loss/FBt2/detection_loss‚1.4753753021359444 epoch‚8 _runtime‚5834.353904678 _step‚427 % _timestamp‚1.7884841822438257e+09 0loss/FRt4/assignment_loss‚2.9723463592075166 /loss/FBt1/detection_loss‚0.6750845176890701 -loss/FBt3/detection_loss‚2.90563679933548 %loss/total_loss‚37.80158320410087 0loss/FBt3/assignment_loss‚0.1319224581303312 1loss/SRqqt3/detection_loss‚2.4749903932946626«êñªc‹‚(:Ø Ö´èÔÔÁÞª network.sent‚ 1.1487685e+07% disk./.usageGB‚2976.2838439941406 disk.sda2.out‚ 677.5234375 disk.md0.in‚ 67.2421875 disk.rbd2.out‚ 1.68359375) proc.memory.availableMB‚ 1199.30859375 disk.rbd2.in‚0 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.453125* proc.memory.percent‚18.835806846618652 network.recv‚ 1.88838e+06 disk.rbd0.in‚0 disk.rbd0.out‚ 1.68359375 disk.sdb.in‚9.453125 cpu‚25.756661481928738 disk.dm-0.in‚ 253.3671875 disk.nvme0n1.in‚ 220.91015625 disk.sdb2.out‚ 677.5234375# proc.memory.rssMB‚ 3086.05859375 proc.cpu.threads‚17 disk.md0p1.in‚ 67.2421875 disk.sdb1.out‚0 disk.sda1.out‚0# disk.nvme0n1.out‚36137.81640625 disk.md0p1.out‚ 652.74609375 disk.sda.in‚ 57.7890625" disk.nvme1n1.out‚ 37043.5703125) disk./.usagePercent‚83.21814194963848 disk.sdb.out‚ 677.5234375 disk.sda2.in‚ 57.7890625 disk.md0.out‚ 652.74609375 disk.dm-0.out‚73181.38671875 disk.sdb1.in‚0 disk.sda.out‚ 677.5234375# memory_percent‚92.6800012588501ûl}³”Œ‚(:‰ Ö´èÔµÿìª gpu.0.gpu‚61.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚219.242' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚54.8105 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0à!ÒÞh‚(:Ý å´èÔÎñ“« disk.sda1.out‚0 disk.nvme0n1.in‚ 220.91015625 disk.sda2.out‚ 679.087890625 proc.cpu.threads‚17 disk.sda1.in‚0" disk.nvme1n1.out‚ 37043.7578125 disk.sdb.in‚9.453125 disk.sdb.out‚ 679.087890625 disk.dm-0.in‚ 253.3671875* proc.memory.percent‚18.835806846618652 disk.sda.out‚ 679.087890625 disk.rbd0.out‚ 1.68359375 disk.rbd2.in‚0 disk.sdb1.in‚0# memory_percent‚92.6781177520752( proc.memory.availableMB‚ 1199.6171875 disk.sdb2.out‚ 679.087890625 cpu‚25.755961152752285) disk./.usagePercent‚83.22164436153176 disk.sda.in‚ 57.7890625 disk.md0.out‚ 654.2578125 disk.md0p1.in‚ 67.2421875 disk.sdb1.out‚0# disk.nvme0n1.out‚36402.47265625 disk.sda2.in‚ 57.7890625 disk.rbd0.in‚0 disk.dm-0.out‚73446.23046875 network.sent‚ 1.1577137e+07 disk.sdb2.in‚9.453125 disk.md0.in‚ 67.2421875 disk.rbd2.out‚ 1.68359375# proc.memory.rssMB‚ 3086.05859375 disk.md0p1.out‚ 654.2578125 disk.nvme1n1.in‚ 32.45703125 network.recv‚ 1.893564e+06$ disk./.usageGB‚2976.409107208252•£i’Ž‚(:‡ å´èÔÐÿ« gpu.0.gpu‚6.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚227.082' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚56.7705 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Œ¾Ì7‘‚(:† ô´èÔÿØ« gpu.0.gpu‚8.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚131.45' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚32.8625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0X½Zd‚(:Ù ô´èÔƒ¯ó«* proc.memory.percent‚18.835806846618652 disk.sdb.out‚ 681.1484375 disk.sdb2.out‚ 681.1484375 disk.md0.in‚ 67.2421875 disk.md0.out‚ 656.26171875 disk.rbd0.out‚ 1.68359375 disk.sda2.in‚ 57.7890625 disk.rbd2.out‚ 1.68359375$ memory_percent‚92.67659187316895# proc.memory.rssMB‚ 3086.05859375 network.sent‚ 1.1582423e+07% disk./.usageGB‚2976.2593688964844 disk.nvme1n1.in‚ 32.45703125 disk.sda2.out‚ 681.1484375 disk.md0p1.out‚ 656.26171875 disk.rbd2.in‚0# disk.nvme0n1.out‚36506.52734375 network.recv‚ 1.897185e+06 disk.dm-0.in‚ 253.3671875 disk.sda.out‚ 681.1484375 disk.nvme0n1.in‚ 220.91015625( proc.memory.availableMB‚ 1199.8671875) disk./.usagePercent‚83.21745761566439" disk.nvme1n1.out‚ 37043.8671875 disk.sdb1.in‚0 disk.sda1.in‚0 cpu‚25.755176928471617 disk.sdb.in‚9.453125 disk.sdb1.out‚0 proc.cpu.threads‚17 disk.sda.in‚ 57.7890625 disk.sdb2.in‚9.453125 disk.md0p1.in‚ 67.2421875 disk.rbd0.in‚0 disk.dm-0.out‚73550.39453125 disk.sda1.out‚0½ôÞŒ‘‚(:… ƒµèÔäµÈ© gpu.0.gpu‚22.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚204.16' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚51.04 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0€÷²j’‚(:ß ƒµèÔ‡ÒŠ« disk.sdb.out‚682.66943359375! disk.sdb2.out‚682.66943359375" disk.nvme0n1.out‚ 36629.6328125 disk.dm-0.in‚ 253.3671875 disk.sda.in‚ 57.7890625# proc.memory.rssMB‚ 3086.05859375) disk./.usagePercent‚83.21621299391506! disk.sda2.out‚682.66943359375 disk.rbd0.out‚ 1.68359375 disk.sdb1.out‚0 disk.sda.out‚682.66943359375* proc.memory.percent‚18.835806846618652 disk.sdb2.in‚9.453125 disk.sdb.in‚9.453125 disk.md0.in‚ 67.2421875 cpu‚25.754494970390144 disk.md0.out‚ 657.72265625 disk.md0p1.in‚ 67.2421875 disk.rbd2.out‚ 1.68359375 network.sent‚ 1.1586672e+07 network.recv‚ 1.901827e+06 disk.nvme0n1.in‚ 220.91015625 disk.nvme1n1.in‚ 32.45703125 disk.sda1.in‚0" disk.nvme1n1.out‚ 37044.1171875 disk.md0p1.out‚ 657.72265625 disk.rbd0.in‚0 disk.dm-0.out‚73673.75$ disk./.usageGB‚2976.214855194092 disk.sda1.out‚0 disk.sda2.in‚ 57.7890625 disk.rbd2.in‚0 disk.sdb1.in‚0& proc.memory.availableMB‚ 1199.28125$ memory_percent‚92.68016815185547 proc.cpu.threads‚17MxO®2“- _wandbruntime‚5888  _runtime‚5888¿=šfȔ ' lr-AdamW/pg1‚5.4011201957643644e-05 ' lr-AdamW/pg2‚5.4011201957643644e-05 trainer/global_step‚5299 % _timestamp‚1.7884842359701443e+09 _runtime‚ 5888.08053663 _step‚428tíqŒÍ•Ç _runtime‚ 5888.08053663 _step‚428 ' lr-AdamW/pg1‚5.4011201957643644e-05 ' lr-AdamW/pg2‚5.4011201957643644e-05 trainer/global_step‚5299 % _timestamp‚1.7884842359701443e+09¬Ñáäq2–- _wandbruntime‚5888  _runtime‚5888•œõ'—ïO F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 213196412 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚731971715980288 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚630126154814976 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚87166131 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚532 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚95808148 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚731970915464192 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚95808150 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚713814227846320 _runtime‚ 5888.08265972 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚731971715980288 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚27562784 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 trainer/global_step‚5299 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚731970915464192 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 117388264 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚87166663 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚59603879 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚623829101211648 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚719605846890932 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚719606645412176 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚726159775632384 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5811923308544 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚429 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 117411536 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚95808150 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 117388264 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5811923308544 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 117411536 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6297053603328 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚713814210806960 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚27562255 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5792417565856 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚726159792671744 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚95808148 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚726159775632384 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚623829076307968 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 213219686 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5791636083972 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5811139831808‚e#ú'˜ôO YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚719606645412176 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚726159775632384 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5811923308544 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚429 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 117411536 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚95808150 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 117388264 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5811923308544 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 117411536 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6297053603328 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚713814210806960 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚27562255 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 5792417565856 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚726159792671744 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚95808148 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚726159775632384 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚623829076307968 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 213219686 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5791636083972 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5811139831808 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 213196412 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚731971715980288 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚630126154814976 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚87166131 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚532 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚95808148 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚731970915464192 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚95808150 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚713814227846320 _runtime‚ 5888.08265972 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚731971715980288 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚27562784 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 trainer/global_step‚5299 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚731970915464192 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 117388264 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚87166663 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚59603879 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚623829101211648 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚719605846890932 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0­äF Ø2™- _wandbruntime‚5889  _runtime‚5889)>ŽìšúM HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚630241452225024 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 % _timestamp‚1.7884842369783282e+09 _step‚430 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 213258852 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚732105533644288 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚523 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚59614639 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚520 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚95825602 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚87181914 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚713944861008000 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚87182437 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚95825602 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 213258852 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 117433250 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚59614636 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5812989660672 >8DeviceStatsMonitor.on_train_batch_end/Kªþ'ínum_oom_rejections‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27567278 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚719737559837298 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚726292543983616 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚5889.089470668 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 117409952 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5812989660672 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6298207210496 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚623943245014528 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6298055370752 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5812206170624 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚630241275481600 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚719738358358750 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5793480311390 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚726292526944256 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚726292543983616 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 213235552 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 117409952 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5792698829298 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚732105533644288 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5812206170624 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚732104733114880 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚95825600 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚623943220110848 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚713944878047360 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚87181914 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚713944861008000 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚87182437 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚95825602 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 213258852 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 117433250 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚59614636 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5812989660672 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27567278 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚719737559837298 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚726292543983616 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 _runtime‚5889.089470668 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 117409952 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5812989660672 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6298207210496 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚623943245014528 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6298055370752 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5812206170624 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚630241275481600 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚719738358358750 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5793480311390 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚726292526944256 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚726292543983616 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 213235552 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 117409952 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5792698829298 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚732105533644288 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5812206170624 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚732104733114880 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚95825600 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚623943220110848 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚713944878047360 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚630241452225024 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 % _timestamp‚1.7884842369783282e+09 _step‚430 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320®xߢ2œ- _wandbruntime‚5889  _runtime‚5889 º‘¸\Ö 1loss/FBt2/assignment_loss‚0.11946024489929948 1loss/FBt3/assignment_loss‚0.36529733929152347 /loss/FBt2/detection_loss‚1.3350053018269439 _runtime‚5889.091193315 2loss/SRqqt4/assignment_loss‚1.4486587744904682 /loss/FBt3/detection_loss‚2.0772384107112885 epoch‚8 trainer/global_step‚5299 0loss/FRt2/assignment_loss‚2.4260088684402894 /loss/FRt4/assignment_loss‚2.851896855138963 /loss/FRt2/detection_loss‚2.0006077554877675 0loss/FRt1/assignment_loss‚1.4139565060723502 /loss/FRt3/assignment_loss‚3.218383032083511 _step‚431 1loss/FBt1/assignment_loss‚0.09051348752361071 /loss/FRt1/detection_loss‚1.7205581846559104 1loss/SRqqt2/detection_loss‚1.1837751754297468 .loss/FBt4/detection_loss‚2.261719272686885 2loss/SRqqt2/assignment_loss‚1.2592410674168097 .loss/FBt1/detection_loss‚0.691218801973195 1loss/FBt4/assignment_loss‚0.32787994463295106 /loss/FRt3/detection_loss‚3.0587942576408387 .loss/FRt4/detection_loss‚2.056788817690861 1loss/SRqqt1/detection_loss‚1.0894540508796695 1loss/SRqqt3/detection_loss‚2.4911234847136905 0loss/SRqqt4/detection_loss‚2.432799454778433 % _timestamp‚1.7884842369808261e+09 2loss/SRqqt1/assignment_loss‚0.9875461196874353 1loss/SRqqt3/assignment_loss‚1.456297901192946 %loss/total_loss‚38.36422310934539Žv¸ažÛ 1loss/FBt2/assignment_loss‚0.11946024489929948 1loss/FBt3/assignment_loss‚0.36529733929152347 /loss/FBt2/detection_loss‚1.3350053018269439 _runtime‚5889.091193315 2loss/SRqqt4/assignment_loss‚1.4486587744904682 /loss/FBt3/detection_loss‚2.0772384107112885 epoch‚8 trainer/global_step‚5299 0loss/FRt2/assignment_loss‚2.4260088684402894 /loss/FRt4/assignment_loss‚2.851896855138963 /loss/FRt2/detection_loss‚2.0006077554877675 0loss/FRt1/assignment_loss‚1.4139565060723502 /loss/FRt3/assignment_loss‚3.218383032083511 _step‚431 1loss/FBt1/assignment_loss‚0.09051348752361071 /loss/FRt1/detection_loss‚1.7205581846559104 1loss/SRqqt2/detection_loss‚1.1837751754297468 .loss/FBt4/detection_loss‚2.261719272686885 2loss/SRqqt2/assignment_loss‚1.2592410674168097 .loss/FBt1/detection_loss‚0.691218801973195 1loss/FBt4/assignment_loss‚0.32787994463295106 /loss/FRt3/detection_loss‚3.0587942576408387 .loss/FRt4/detection_loss‚2.056788817690861 1loss/SRqqt1/detection_loss‚1.0894540508796695 1loss/SRqqt3/detection_loss‚2.4911234847136905 0loss/SRqqt4/detection_loss‚2.432799454778433 % _timestamp‚1.7884842369808261e+09 2loss/SRqqt1/assignment_loss‚0.9875461196874353 1loss/SRqqt3/assignment_loss‚1.456297901192946 %loss/total_loss‚38.36422310934539¯b‰ÎIžŸ‚(:“ ’µèÔ䳫« gpu.0.gpu‚20.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚115.634' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚28.908499999999997 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0㫽Ún ‚(:ã ’µèÔÝŸ¬ disk.dm-0.out‚73803.61328125 network.sent‚ 1.1604623e+07$ disk./.usageGB‚2976.533893585205 disk.sda.out‚684.11181640625 disk.md0p1.in‚ 67.2421875) disk./.usagePercent‚83.22513344085853 disk.sdb1.out‚0 disk.sda1.in‚0 disk.md0.in‚ 67.2421875 disk.sdb1.in‚0# disk.nvme1n1.out‚37044.22265625$ memory_percent‚92.67809391021729 disk.sdb.in‚9.453125 disk.sdb.out‚684.11181640625 disk.md0.out‚ 659.109375 proc.cpu.threads‚17 disk.rbd2.out‚ 1.68359375 disk.nvme0n1.in‚ 220.91015625 disk.dm-0.in‚ 253.3671875! disk.sdb2.out‚684.11181640625 disk.md0p1.out‚ 659.109375 disk.rbd0.in‚0* proc.memory.percent‚18.835806846618652 disk.rbd2.in‚0 disk.sda.in‚ 57.7890625 disk.sdb2.in‚9.453125! disk.sda2.out‚684.11181640625) proc.memory.availableMB‚ 1199.62109375# proc.memory.rssMB‚ 3086.05859375 cpu‚25.75388280282709 network.recv‚ 1.905228e+06 disk.sda1.out‚0! disk.nvme0n1.out‚ 36759.390625 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.7890625 disk.rbd0.out‚ 1.68359375Ë~'Š”¡‚(:‰ ¡µèÔüÏ·© gpu.0.gpu‚50.0 gpu.0.memory‚8, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚148.833' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚37.20825 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ž!(Qc¢‚(:Ø ¡µèÔƒßĪ$ disk./.usageGB‚2976.659152984619 disk.sdb1.in‚0 disk.sda.in‚ 57.7890625 disk.sdb2.in‚9.453125 disk.rbd2.out‚ 1.68359375# disk.nvme0n1.out‚36873.79296875) disk./.usagePercent‚83.22863574609127 disk.rbd0.out‚ 1.68359375 disk.dm-0.out‚ 73918.21875 disk.rbd2.in‚0 disk.sda.out‚ 686.416015625 disk.md0.in‚ 67.2421875# memory_percent‚92.6781415939331 proc.cpu.threads‚17 disk.sdb.in‚9.453125 cpu‚25.753173820172602 network.sent‚ 1.1681315e+07 disk.sdb.out‚ 686.416015625 disk.sdb2.out‚ 686.416015625 disk.sda2.in‚ 57.7890625 disk.md0.out‚ 661.34375* proc.memory.percent‚18.835806846618652 disk.rbd0.in‚0 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.91015625# disk.nvme1n1.out‚37044.42578125) proc.memory.availableMB‚ 1199.61328125 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚ 661.34375 disk.dm-0.in‚ 253.3671875 disk.sda1.out‚0 network.recv‚ 1.911028e+06 disk.sdb1.out‚0 disk.nvme1n1.in‚ 32.45703125 disk.sda2.out‚ 686.416015625# proc.memory.rssMB‚ 3086.05859375H”£‚(:‰ °µèÔó¤¬ gpu.0.gpu‚35.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0UÉË`k¤‚(:à °µèÔ€ûÚ­ disk.sdb.in‚9.453125 disk.md0.out‚ 662.59765625 cpu‚25.752508150690932 disk.sda.in‚ 57.7890625 proc.cpu.threads‚17" disk.nvme1n1.out‚ 37044.5390625# proc.memory.rssMB‚ 3086.05859375 disk.md0p1.out‚ 662.59765625 disk.rbd2.in‚0# disk.nvme0n1.out‚37087.49609375 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.out‚687.7294921875 disk.sdb.out‚687.7294921875$ memory_percent‚92.67730712890625# proc.memory.availableMB‚1199.75) disk./.usagePercent‚83.23212119895996 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875 disk.dm-0.out‚74132.03515625 disk.sdb1.in‚0 disk.sda.out‚687.7294921875* proc.memory.percent‚18.835806846618652 disk.sdb1.out‚0 disk.sda2.out‚687.7294921875 network.sent‚ 1.1684174e+07% disk./.usageGB‚2976.7838096618652 disk.rbd2.out‚ 1.68359375 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.91015625 disk.sdb2.in‚9.453125 disk.md0.in‚ 67.2421875 disk.sda2.in‚ 57.7890625 network.recv‚ 1.914003e+06 disk.md0p1.in‚ 67.2421875 disk.rbd0.out‚ 1.68359375 disk.sda1.in‚0†ƒ-•¥‚(:Š ¿µèÔ½ú© gpu.0.gpu‚79.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚222.027' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.50675 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0#ÅGþi¦‚(:Þ ¿µèÔﳡ« disk.nvme0n1.in‚ 220.91015625! disk.sdb2.out‚689.22900390625 disk.md0p1.out‚ 664.03125 disk.rbd2.in‚0* proc.memory.percent‚18.835806846618652 cpu‚25.751771033615643 network.recv‚ 1.91875e+06( disk./.usagePercent‚83.2461578316477 disk.sda1.in‚0 disk.sdb.in‚9.453125 disk.sdb2.in‚9.453125 disk.md0p1.in‚ 67.2421875 disk.rbd2.out‚ 1.68359375# proc.memory.rssMB‚ 3086.05859375 disk.dm-0.in‚ 253.3671875 disk.rbd0.out‚ 1.68359375 disk.sda.in‚ 57.7890625 disk.sda1.out‚0 disk.nvme0n1.out‚ 37275.96875 disk.sdb.out‚689.22900390625 disk.md0.in‚ 67.2421875) proc.memory.availableMB‚ 1199.64453125 network.sent‚ 1.1689827e+07 disk.sda.out‚689.22900390625 disk.rbd0.in‚0$ memory_percent‚92.67795085906982 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.md0.out‚ 664.03125% disk./.usageGB‚2977.2858276367188 disk.nvme1n1.in‚ 32.45703125" disk.nvme1n1.out‚ 37044.7265625 disk.sda2.in‚ 57.7890625! disk.sda2.out‚689.22900390625 proc.cpu.threads‚17 disk.dm-0.out‚ 74320.6953125¢ù¤2§- _wandbruntime‚5943  _runtime‚5943¡(0Kɨà _step‚432 ' lr-AdamW/pg1‚4.7062119659465073e-05 ' lr-AdamW/pg2‚4.7062119659465073e-05 trainer/global_step‚5349 % _timestamp‚1.7884842914376602e+09 _runtime‚5943.548019736„ŠÒÎ©È ' lr-AdamW/pg1‚4.7062119659465073e-05 ' lr-AdamW/pg2‚4.7062119659465073e-05 trainer/global_step‚5349 % _timestamp‚1.7884842914376602e+09 _runtime‚5943.548019736 _step‚432°@VµÚ2ª- _wandbruntime‚5943  _runtime‚5943pj(¦«ïO \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚732797341225984 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5864484600832 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 118499288 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚732797341225984 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 215156764 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 215180038 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚96680748 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚551 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 118476016 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚732797358265344 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚738662626342912 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚720346720858960 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 5844800522280 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚738661825826816 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚635891143344128 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚738661825826816 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚629536266451968 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚27814937 trainer/global_step‚5349 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 118476016 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 118499288 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6354851988480 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 _runtime‚5943.551696793 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚87956816 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚732797358265344 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚554 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚635890960295936 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5864484600832 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚738662626342912 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5865268077568 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚60141879 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚60141876 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚96680748 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 $ _timestamp‚1.788484291441284e+09 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚87956262 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚27814386 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6354693843968 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚738661825826816 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚629536266451968 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚27814937 trainer/global_step‚5349 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 118476016 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 118499288 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6354851988480 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 _runtime‚5943.551696793 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚87956816 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚732797358265344 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚554 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚635890960295936 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5864484600832 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚738662626342912 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5865268077568 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚60141879 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚60141876 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚96680748 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 $ _timestamp‚1.788484291441284e+09 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚87956262 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚27814386 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6354693843968 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360±‹¤ÿ¿2­- _wandbruntime‚5944  _runtime‚5944ص²ÿ&®ùM ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚87972041 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 215219204 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚96698202 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚732930092537856 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5865550939648 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚629650435158528 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 215195904 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚535 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚27819937 _runtime‚5944.419224226 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚96698200 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5865550939648 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚87972576 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚60152639 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27819405 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 $ _timestamp‚1.788484292308306e+09 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5845863267606 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 215219204 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚738796444006912 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚636006267236864 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚738796444006912 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚732930109577216 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚720477388099360 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚720477371060000 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚732930109577216 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2¾0%c&¯þM K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚87972041 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 215219204 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚96698202 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚732930092537856 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 5865550939648 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚629650435158528 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 215195904 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚535 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚27819937 _runtime‚5944.419224226 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚96698200 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5865550939648 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚87972576 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚60152639 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚27819405 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 $ _timestamp‚1.788484292308306e+09 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 5845863267606 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 215219204 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚738796444006912 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚636006267236864 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚738796444006912 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 151839744 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚732930109577216 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚720477388099360 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚720477371060000 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚732930109577216 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 ¨Ùúx¡D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352²tŒ Y2°- _wandbruntime‚5944  _runtime‚5944? \±Ö 1loss/FBt2/assignment_loss‚0.17170028100312515 2loss/SRqqt3/assignment_loss‚1.6957220707802063 0loss/FBt1/assignment_loss‚0.0784947235390903 /loss/FRt3/detection_loss‚3.3783495358445426 /loss/FBt4/detection_loss‚2.3560553739468255 /loss/FRt4/detection_loss‚2.0948352097279543 /loss/FBt2/detection_loss‚1.4705965896287272 %loss/total_loss‚37.98893084352733 /loss/FRt2/detection_loss‚1.8862825850956142 0loss/FRt4/assignment_loss‚2.8746726455596776 2loss/SRqqt1/assignment_loss‚0.9040012457808189 2loss/SRqqt4/assignment_loss‚1.4404150897503964 _step‚435 1loss/SRqqt1/detection_loss‚1.0619599646452116 % _timestamp‚1.7884842923108451e+09 0loss/SRqqt4/detection_loss‚2.257697008550167 1loss/SRqqt2/assignment_loss‚1.314832670068282 /loss/FRt1/detection_loss‚1.7407828180805633 epoch‚8 /loss/FBt3/detection_loss‚1.9683940466493368 trainer/global_step‚5349 .loss/FRt1/assignment_loss‚1.17141924594578 0loss/FRt2/assignment_loss‚1.8381497832360092 0loss/FBt3/assignment_loss‚0.2904118169910461 0loss/FBt4/assignment_loss‚0.3367668327607494 _runtime‚5944.420914283 0loss/FRt3/assignment_loss‚2.8626830645582895 1loss/SRqqt2/detection_loss‚1.2594415030460682 1loss/SRqqt3/detection_loss‚2.8690806678000915 /loss/FBt1/detection_loss‚0.6661860705387559Œ»téa²Û 0loss/FRt3/assignment_loss‚2.8626830645582895 1loss/SRqqt2/detection_loss‚1.2594415030460682 1loss/SRqqt3/detection_loss‚2.8690806678000915 /loss/FBt1/detection_loss‚0.6661860705387559 1loss/FBt2/assignment_loss‚0.17170028100312515 2loss/SRqqt3/assignment_loss‚1.6957220707802063 0loss/FBt1/assignment_loss‚0.0784947235390903 /loss/FRt3/detection_loss‚3.3783495358445426 /loss/FBt4/detection_loss‚2.3560553739468255 /loss/FRt4/detection_loss‚2.0948352097279543 /loss/FBt2/detection_loss‚1.4705965896287272 %loss/total_loss‚37.98893084352733 /loss/FRt2/detection_loss‚1.8862825850956142 0loss/FRt4/assignment_loss‚2.8746726455596776 2loss/SRqqt1/assignment_loss‚0.9040012457808189 2loss/SRqqt4/assignment_loss‚1.4404150897503964 _step‚435 1loss/SRqqt1/detection_loss‚1.0619599646452116 % _timestamp‚1.7884842923108451e+09 0loss/SRqqt4/detection_loss‚2.257697008550167 1loss/SRqqt2/assignment_loss‚1.314832670068282 /loss/FRt1/detection_loss‚1.7407828180805633 epoch‚8 /loss/FBt3/detection_loss‚1.9683940466493368 trainer/global_step‚5349 .loss/FRt1/assignment_loss‚1.17141924594578 0loss/FRt2/assignment_loss‚1.8381497832360092 0loss/FBt3/assignment_loss‚0.2904118169910461 0loss/FBt4/assignment_loss‚0.3367668327607494 _runtime‚5944.420914283³‚òŸ³‚(:” εèÔ‡Õö© gpu.0.gpu‚70.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚209.937' gpu.0.enforcedPowerLimitWatts‚400.0) gpu.0.powerPercent‚52.484249999999996 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Pb£¼f´‚(:Û εèÔïÆ­) disk./.usagePercent‚83.24610290147365 disk.rbd2.in‚0 disk.sdb1.out‚0" disk.nvme1n1.out‚ 37044.8671875 disk.sdb.in‚9.453125 disk.sda2.out‚690.7392578125 disk.rbd2.out‚ 1.68359375 disk.nvme0n1.in‚ 220.91015625 disk.rbd0.out‚ 1.68359375 disk.sda1.in‚0 disk.md0p1.out‚ 665.4609375$ memory_percent‚92.67764091491699( proc.memory.availableMB‚ 1199.6953125 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.2421875$ disk./.usageGB‚2977.283863067627 disk.dm-0.in‚ 253.3671875 disk.sda.in‚ 57.7890625 disk.sda1.out‚0 disk.sda2.in‚ 57.7890625# proc.memory.rssMB‚ 3086.05859375 cpu‚25.75112446779536 disk.md0p1.in‚ 67.2421875 disk.dm-0.out‚ 74559.9296875 disk.nvme0n1.out‚ 37515.0625 disk.sdb.out‚690.7392578125 disk.sdb2.out‚690.7392578125 proc.cpu.threads‚17 network.sent‚ 1.1707894e+07 network.recv‚ 1.92236e+06 disk.sdb1.in‚0 disk.sdb2.in‚9.453125 disk.md0.out‚ 665.4609375 disk.rbd0.in‚0* proc.memory.percent‚18.835806846618652 disk.sda.out‚690.7392578125ï§`µ‚(:„ ݵèÔÇ …« gpu.0.gpu‚78.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚220.8' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.2 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÀÔJOp¶‚(:å ݵèÔ¶¦º« disk.nvme0n1.in‚ 220.91015625 disk.nvme0n1.out‚ 37680.34375 disk.sda.in‚ 57.7890625# disk.nvme1n1.out‚37045.07421875! disk.sda2.out‚692.85205078125 disk.md0.out‚ 667.51171875) proc.memory.availableMB‚ 1199.66796875) disk./.usagePercent‚83.23841459699726 disk.sda.out‚692.85205078125 disk.sdb.in‚9.453125 disk.md0.in‚ 67.2421875 disk.dm-0.out‚74725.41796875 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda2.in‚ 57.7890625 disk.md0p1.out‚ 667.51171875 disk.rbd2.out‚ 1.68359375$ memory_percent‚92.67780780792236# proc.memory.rssMB‚ 3086.05859375* proc.memory.percent‚18.835806846618652 cpu‚25.750470030099788 network.recv‚ 1.9284e+06 disk.sda1.in‚0 disk.md0p1.in‚ 67.2421875 disk.dm-0.in‚ 253.3671875 proc.cpu.threads‚17 network.sent‚ 1.1784686e+07 disk.sdb.out‚692.85205078125 disk.sdb2.in‚9.453125$ disk./.usageGB‚2977.008892059326 disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚692.85205078125 disk.sdb1.out‚0 disk.sda1.out‚0 disk.rbd0.in‚0 disk.rbd0.out‚ 1.68359375 Âq‹•·‚(:Š ìµèÔú­®« gpu.0.gpu‚66.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚198.797' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚49.69925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0-IBi¸‚(:Þ ìµèÔ€Í⬠disk.sdb2.in‚9.453125 disk.rbd0.out‚ 1.68359375 disk.dm-0.out‚ 74855.875 disk.sda.out‚694.41748046875# proc.memory.rssMB‚ 3086.05859375* proc.memory.percent‚18.835806846618652 disk.rbd2.out‚ 1.68359375 disk.sda1.in‚0 disk.sdb.in‚9.453125 cpu‚25.749543754581868) disk./.usagePercent‚83.23905498683212 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda1.out‚0 disk.sda2.in‚ 57.7890625 disk.md0p1.out‚ 669.0234375 disk.sdb1.out‚0" disk.nvme1n1.out‚ 37045.2578125 disk.sdb.out‚694.41748046875 proc.cpu.threads‚17 network.recv‚ 1.93239e+06$ disk./.usageGB‚2977.031795501709 disk.md0.in‚ 67.2421875" disk.nvme0n1.out‚ 37810.6171875$ memory_percent‚92.67783164978027 disk.md0p1.in‚ 67.2421875 network.sent‚ 1.178765e+07 disk.rbd0.in‚0! disk.sdb2.out‚694.41748046875! disk.sda2.out‚694.41748046875 disk.md0.out‚ 669.0234375 disk.dm-0.in‚ 253.3671875 disk.sda.in‚ 57.7890625 disk.nvme0n1.in‚ 220.91015625 disk.nvme1n1.in‚ 32.45703125( proc.memory.availableMB‚ 1199.6640625íJ›q“¹‚(:ˆ ûµèÔú®‰¬ gpu.0.gpu‚3.0 gpu.0.memory‚2, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0d}yøoº‚(:ä ûµèÔµ÷™­ disk.sda1.in‚0 disk.nvme0n1.in‚ 220.91015625 disk.sdb.in‚9.453125 disk.sdb.out‚695.92431640625 disk.sdb2.in‚9.453125 disk.rbd2.out‚ 1.68359375$ memory_percent‚92.67845153808594 disk.sda1.out‚0 disk.md0.out‚ 670.47265625 disk.dm-0.in‚ 253.3671875 disk.sdb1.in‚0 disk.sdb1.out‚0! disk.sdb2.out‚695.92431640625! disk.sda2.out‚695.92431640625 disk.md0p1.in‚ 67.2421875# proc.memory.rssMB‚ 3086.05859375* proc.memory.percent‚18.835806846618652 cpu‚25.74900265563374) disk./.usagePercent‚83.23998911977245 disk.sda.in‚ 57.7890625! disk.nvme1n1.out‚ 37045.421875 disk.sda2.in‚ 57.7890625 disk.rbd0.in‚0 disk.rbd2.in‚0% proc.memory.availableMB‚ 1199.5625 network.recv‚ 1.937204e+06 disk.sda.out‚695.92431640625 disk.md0p1.out‚ 670.47265625 disk.dm-0.out‚74919.54296875 network.sent‚ 1.1794055e+07% disk./.usageGB‚2977.0652046203613# disk.nvme0n1.out‚37874.12109375 disk.rbd0.out‚ 1.68359375 disk.md0.in‚ 67.2421875 disk.nvme1n1.in‚ 32.45703125 proc.cpu.threads‚17}—H2»- _wandbruntime‚6000  _runtime‚6000£†ë%ǼÁ & lr-AdamW/pg1‚4.057312760778891e-05 & lr-AdamW/pg2‚4.057312760778891e-05 trainer/global_step‚5399 % _timestamp‚1.7884843482450275e+09 _runtime‚6000.359043199 _step‚436Ç‚çÌ½Æ _step‚436 & lr-AdamW/pg1‚4.057312760778891e-05 & lr-AdamW/pg2‚4.057312760778891e-05 trainer/global_step‚5399 % _timestamp‚1.7884843482450275e+09 _runtime‚6000.359043199´á&—2¾- _wandbruntime‚6000  _runtime‚6000Ðþ4õ'¿ïO M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚88746020 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5917829369856 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚97553350 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚97553348 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚635243456595968 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚97553350 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚543 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 217140390 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚739434923858944 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚28066144 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚635243481499648 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 119563768 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚60679876 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚732777994392792 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 119563768 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 119587040 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _step‚437 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5918612846592 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 $ _timestamp‚1.788484348250031e+09 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚641655966967296 BDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚739434923858944 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚739434906819584 _runtime‚6000.360989718 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚745352736189440 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚88746566 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚546 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚745353536705536 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6412674807296 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚726879230910960 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚28066687 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚641656156306944 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚745353536705536 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚97553348 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚726879247950320 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 119587040 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5918612846592 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696ÓÉ=—ú'ÀôO H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚739434923858944 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚739434906819584 _runtime‚6000.360989718 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚745352736189440 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚88746566 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚546 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚745353536705536 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6412674807296 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚726879230910960 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚28066687 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚641656156306944 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚745353536705536 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚97553348 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚726879247950320 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 119587040 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 5918612846592 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚88746020 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 5917829369856 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚97553350 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚97553348 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚635243456595968 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚97553350 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚543 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 217140390 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚739434923858944 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚28066144 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚635243481499648 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 119563768 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚60679876 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚732777994392792 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 119563768 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 119587040 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 _step‚437 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 5918612846592 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 $ _timestamp‚1.788484348250031e+09 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚641655966967296 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚732908908817914 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚727009881112000 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 119585456 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5918895708672 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚635357600398848 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 trainer/global_step‚5399 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5919679198720 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚88761724 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚28071088 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚745486553840128 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚739567658131456 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5919679198720 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚518 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6413817189376 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 217179556 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚739567675170816 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 119585456 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092îñbT'ÃÿM ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚727009898151360 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚739567658131456 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚60690639 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚745487354369536 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚739567675170816 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 % _timestamp‚1.7884843493280106e+09 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚97570800 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 119608754 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 217156256 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚97570800 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚641771442491904 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚635357625302528 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 _runtime‚6001.439326508 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 119608754 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 217179556 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚739567675170816 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 119585456 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 217156256 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚88762245 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚60690636 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚732908908817914 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚727009881112000 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 119585456 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5918895708672 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚635357600398848 EDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 trainer/global_step‚5399 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 5919679198720 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚88761724 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚28071088 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 187229184 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚745486553840128 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚739567658131456 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5919679198720 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚518 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6413817189376 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 217179556 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 B&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9934912323951721 *loss/val_total_loss‚37.523191992865634 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4539106786251068 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ) Purity/*FRt4SRqqt0FBt/FRt_purity‚0.25 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.40958112478256226 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.38435089588165283 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.02500000037252903 particle/accuracy_1_of_1‚1 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.2421875 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03787878900766373 *jet/accuracy_1_of_2‚0.7225202918052673 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9942372441291809 :"Purity/1FRt2SRqqt1FBt/event_purity‚0.01105990819633007 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1785714328289032 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.18896450102329254 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0034164944663643837 <"Purity/2FRt1SRqqt0FBt/event_purity‚0.0037220846861600876 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5704324245452881 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 :"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.43847841024398804 +jet/accuracy_2_of_3‚0.24233025312423706 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.05000000074505806 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 8"Purity/0FRt1SRqqt0FBt/event_purity‚0.370488703250885 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 particle/accuracy_1_of_2‚1 jet/accuracy_3_of_7‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 epoch‚8 6 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.998720109462738 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.40239959955215454 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.014174938201904297 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_4‚1 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.3004030380398Õ‚Y˜ù04e-05 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.7380952835083008 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.25641027092933655 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.11999999731779099 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9691274762153625 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.3222222328186035 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.15750393271446228 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt*SRqqt2FBt/event_purity‚0.0958222970366478 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5687075257301331 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.22549018263816833 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 *jet/accuracy_3_of_4‚0.0622410774230957 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3333333730697632 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4753086566925049 & Purity/1FRt*SRqqt4FBt/FRt_purity‚0 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 particle/accuracy_1_of_7‚1 & Purity/1FRt0SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2340448647737503 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9996017217636108 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5644542574882507 6 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.200576052069664 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.20987656712532043 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3958333432674408 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ,jet/accuracy_4_of_5‚0.017893576994538307 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 ) Purity/4FRt*SRqqt*FBt/FRt_purity‚0.25 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 ,jet/accuracy_4_of_4‚0.008940337225794792 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 ) Purity/4FRt*SRqqt0FBt/FRt_purity‚0.25 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4052121341228485 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.1935099959373474 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3753200173377991 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.19305555522441864 particle/accuracy_7_of_7‚1 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5280947089195251 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.7083333134651184 +jet/accuracy_1_of_1‚0.43586286902427673 particle/accuracy_6_of_7‚1 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 8 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.49358975887298584 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9982088804244995 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5083056688308716 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 ;"Purity/2FRt1SRqqt*FBt/event_purity‚0.004274473991245031 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8128120303153992 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.021633384749293327 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.37460318207740784 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18893417716026306 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.30000001192092896 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.4285714328289032 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0011947430903092027 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9928166270256042 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 6validation_average_jet_accuracy‚0.4092567265033722 particle/accuracy_3_of_6‚1 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.019838441163301468 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4115765392780304 particle/accuracy_2_of_5‚1 (particle/accuracy‚0.8499610424041748 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 jet/accuracy_7_of_7‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9903018474578857 8"Purity/*FRt0SRqqt3FBt/event_purity‚0.130952388048172 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9917144775390625 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2081986516714096 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.24285154044628143 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.45394736528396606 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.17496971786022186 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.24077165126800537 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2680545449256897 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2757529318332672 8"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.694444477558136 +jet/accuracy_2_of_4‚0.35239291191101074 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 jet/accuracy_6_of_7‚0 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 7 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.1984456479549408 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3056703209877014 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.038851648569107056 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3888888657093048 8"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.370488703250885 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.06361111253499985 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22963403165340424 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 :"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.42916232347488403 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.31046995520591736 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9919471144676208 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.22343264520168304 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.07758620381355286 8 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.27710333466529846 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.35555046796798706 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.31111109256744385 jet/accuracy_1_of_7‚1 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 9"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.4279382526874542 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5180565118789673 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9980034232139587 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4052627682685852 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4410784840583801 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.4285714328289032 _step‚440 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 9"Purity/*FRt1SRqqt*FBt/event_purity‚0.1728462129831314 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9975894093513489 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.33560606837272644 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3399544358253479 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 ,jet/accuracy_3_of_3‚0.026387574151158333 7 Purity/1FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9479166865348816 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 7 Purity/1FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.38360729813575745 8"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.549281656742096 6 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.269011527299881 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ;"Purity/0FRt2SRqqt0FBt/event_purity‚0.041350238025188446 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.39477303624153137 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.2309523969888687 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 particle/accuracy_2_of_3‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.42011064291000366 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_1_of_4‚0.9036848545074463 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9147510528564453 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.22542858123779297 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 9"Purity/1FRt1SRqqt1FBt/event_purity‚0.0405399352312088 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6244860291481018 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.42232272028923035 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.3204365372657776 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9206350445747375 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9851189851760864 :"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.34599995613098145 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 *jet/accuracy_2_of_2‚0.1120252013206482 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 :"Purity/*FRt0SRqqt2FBt/event_purity‚0.25631821155548096 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.3125 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 particle/accuracy_3_of_3‚1 7 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.2326180338859558 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.04740740731358528 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 7 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.2761268615722656 ;"Purity/0FRt*SRqqt3FBt/event_purity‚0.061728399246931076 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 +jet/accuracy_4_of_6‚0.02631578966975212 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3485209047794342 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3104749917984009 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9923309087753296 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.14586219191551208 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_5_of_5‚0 +particle/sensitivity‚0.3403591513633728 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.05000000074505806 7 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.2284323275089264 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.29996150732040405 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.31683677434921265 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5603174567222595 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9939948916435242 <"Purity/1FRt1SRqqt2FBt/event_purity‚0.0071428571827709675 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.18765072524547577 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 *jet/accuracy_1_of_6‚0.9473684430122375 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.5087719559669495 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 trainer/global_step‚5435 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 7 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.2886899411678314 particle/accuracy_1_of_6‚1 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 % _timestamp‚1.7884844363999252e+09 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11433582752943039 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.19711172580718994 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9886075854301453 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 *jet/accuracy_1_of_3‚0.8443751335144043 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.2941282093524933 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.46597546339035034 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19369760155677795 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11830436438322067 :"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.39132699370384216 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 particle/accuracy_1_of_5‚1 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9871938228607178 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4176592528820038 +particle/specificity‚0.9442809224128723 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 6 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.573091447353363 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 :"Purity/2FRt*SRqqt*FBt/event_purity‚0.01175687089562416 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7587718963623047 particle/accuracy_3_of_4‚1 +jet/accuracy_3_of_6‚0.09649123251438141 particle/accuracy_2_of_7‚1 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.4555555284023285 :"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.38922345638275146 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 particle/accuracy_6_of_6‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.017189476639032364 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3672507107257843 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979884624481201 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5281308889389038 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8930041790008545 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.28623223304748535 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2222222238779068 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 :"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.42533814907073975 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 6 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.539722204208374 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5744047164916992 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.26165544986724854 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9894455671310425 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 *jet/accuracy_2_of_6‚0.5526315569877625 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 :"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.45694443583488464 8"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.494649201631546 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 9"Purity/*FRt2SRqqt1FBt/event_purity‚0.0145695386454463 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 particle/accuracy_3_of_7‚1 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.3956906795501709 & Purity/*FRt*SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7028423547744751 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.024252405390143394 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.4615384638309479 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.3916666507720947 & Purity/*FRt0SRqqt4FBt/FRt_purity‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9878480434417725 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 8"Purity/1FRt0SRqqt*FBt/event_purity‚0.239564448595047 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5448415279388428 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 :"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.46436506509780884 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.3271889388561249 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9877082109451294 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.24047620594501495 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.2306763380765915 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.24358974397182465 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.26466917991638184 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.24888303875923157 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5003337264060974 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 7 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.2326389104127884 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 jet/accuracy_4_of_7‚0 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.03745518997311592 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 particle/accuracy_5_of_5‚1 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5376637578010559 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 + Purity/0FRt3SRqqt1FBt/FBt_purity‚0.9375 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 +jet/accuracy_3_of_5‚0.09372751414775848 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.2578125 jet/accuracy_5_of_7‚0 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3613886535167694 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9133334159851074 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3159862458705902 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6040322780609131 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.22343264520168304 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 *jet/accuracy_1_of_5‚0.9563212990760803 particle/accuracy_5_of_6‚1 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.27025413513183594 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 9"Purity/1FRt*SRqqt0FBt/event_purity‚0.1017458438873291 ;"Purity/3FRt*SRqqt1FBt/event_purity‚0.024242425337433815 particle/accuracy_2_of_4‚1 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.30000001192092896 :"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.43886157870292664 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 ( Purity/4FRt1SRqqt0FBt/FRt_purity‚0.5 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.3737908601760864 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4197896420955658 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.025681568309664726 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.25170668959617615 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.44042131304740906 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5602050423622131 ;"Purity/3FRt*SRqqt*FBt/event_purity‚0.008192525245249271 *jet/accuracy_2_of_5‚0.4751370847225189 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.30000001192092896 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6764705777168274 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.20000000298023224 + Purity/0FRt3SRqqt*FBt/FBt_purity‚0.9375 ( Purity/4FRt1SRqqt*FBt/FRt_purity‚0.5 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 9"Purity/*FRt*SRqqt1FBt/event_purity‚0.4218382239341736 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9879381656646729 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 <"Purity/2FRt*SRqqt0FBt/event_purity‚0.0067478809505701065 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 jet/accuracy_6_of_6‚0 jet/accuracy_2_of_7‚0.5 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5086805820465088 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9870370030403137 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 6 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.920634925365448 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6666666865348816 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9854983687400818 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.32464098930358887 8"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.472222238779068 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6497535109519958 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_5‚1 particle/accuracy_5_of_7‚1 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.017499366775155067 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.19126905500888824 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.3587987422943115 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.7380952835083008 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9902248978614807 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6043831706047058 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.02604139968752861 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7938596606254578 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 :"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.40772393345832825 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.20339415967464447 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4728260934352875 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5353187322616577 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.40709033608436584 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.20919892191886902 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 7 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.2060053050518036 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 + Purity/1FRt*SRqqt3FBt/FRt_purity‚0.6875 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4094387888908386 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 :"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.44257789850234985 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 & Purity/0FRt4SRqqt1FBt/FBt_purit@ZÊí`y‚1 jet/accuracy_5_of_6‚0 _runtime‚6088.512381815 7 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.2003604918718338 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6785714030265808 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24270352721214294 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 particle/accuracy_2_of_6‚1 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011üƒá’}Óí¨ :"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.38360729813575745 8"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.549281656742096 6 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.269011527299881 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ;"Purity/0FRt2SRqqt0FBt/event_purity‚0.041350238025188446 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.39477303624153137 7 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.2309523969888687 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 particle/accuracy_2_of_3‚1 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.42011064291000366 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 *jet/accuracy_1_of_4‚0.9036848545074463 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9147510528564453 8 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.22542858123779297 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 9"Purity/1FRt1SRqqt1FBt/event_purity‚0.0405399352312088 9"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.6244860291481018 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.42232272028923035 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 9"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.3204365372657776 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9206350445747375 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9851189851760864 :"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.34599995613098145 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 *jet/accuracy_2_of_2‚0.1120252013206482 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 :"Purity/*FRt0SRqqt2FBt/event_purity‚0.25631821155548096 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.3125 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 particle/accuracy_3_of_3‚1 7 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.2326180338859558 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 :"Purity/2FRt0SRqqt1FBt/event_purity‚0.04740740731358528 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 7 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.2761268615722656 ;"Purity/0FRt*SRqqt3FBt/event_purity‚0.061728399246931076 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 +jet/accuracy_4_of_6‚0.02631578966975212 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 9"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.3485209047794342 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3104749917984009 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9923309087753296 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.14586219191551208 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 jet/accuracy_5_of_5‚0 +particle/sensitivity‚0.3403591513633728 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.05000000074505806 7 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.2284323275089264 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.29996150732040405 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.31683677434921265 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5603174567222595 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9939948916435242 <"Purity/1FRt1SRqqt2FBt/event_purity‚0.0071428571827709675 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.18765072524547577 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_4_of_4‚1 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 *jet/accuracy_1_of_6‚0.9473684430122375 9"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.5087719559669495 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 trainer/global_step‚5435 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 7 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.2886899411678314 particle/accuracy_1_of_6‚1 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 % _timestamp‚1.7884844363999252e+09 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.11433582752943039 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.19711172580718994 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9886075854301453 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 *jet/accuracy_1_of_3‚0.8443751335144043 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 9"Purity/0FRt*SRqqt0FBt/event_purity‚0.2941282093524933 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.46597546339035034 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.19369760155677795 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11830436438322067 :"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.39132699370384216 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 particle/accuracy_1_of_5‚1 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9871938228607178 9"Purity/0FRt*SRqqt*FBt/event_purity‚0.4176592528820038 +particle/specificity‚0.9442809224128723 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 6 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.573091447353363 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 :"Purity/2FRt*SRqqt*FBt/event_purity‚0.01175687089562416 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7587718963623047 particle/accuracy_3_of_4‚1 +jet/accuracy_3_of_6‚0.09649123251438141 particle/accuracy_2_of_7‚1 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 9"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.4555555284023285 :"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.38922345638275146 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 particle/accuracy_6_of_6‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 ;"Purity/*FRt2SRqqt*FBt/event_purity‚0.017189476639032364 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3672507107257843 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979884624481201 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5281308889389038 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 7 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.8930041790008545 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 8 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.28623223304748535 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2222222238779068 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 :"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.42533814907073975 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 6 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.539722204208374 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5744047164916992 8 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.26165544986724854 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9894455671310425 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 *jet/accuracy_2_of_6‚0.5526315569877625 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 :"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.45694443583488464 8"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.494649201631546 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 9"Purity/*FRt2SRqqt1FBt/event_purity‚0.0145695386454463 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 particle/accuracy_3_of_7‚1 9"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.3956906795501709 & Purity/*FRt*SRqqt4FBt/FRt_purity‚0 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7028423547744751 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.024252405390143394 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.4615384638309479 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.3916666507720947 & Purity/*FRt0SRqqt4FBt/FRt_purity‚0 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9878480434417725 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 8"Purity/1FRt0SRqqt*FBt/event_purity‚0.239564448595047 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 particle/accuracy_4_of_6‚1 ("Purity/0FRt3SRqqt1FBt/event_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5448415279388428 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 :"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.46436506509780884 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 7 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.3271889388561249 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9877082109451294 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.24047620594501495 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 7 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.2306763380765915 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.24358974397182465 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.26466917991638184 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.24888303875923157 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.5003337264060974 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 7 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.2326389104127884 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 jet/accuracy_4_of_7‚0 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 :"Purity/0FRt2SRqqt*FBt/event_purity‚0.03745518997311592 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 particle/accuracy_5_of_5‚1 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5376637578010559 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 + Purity/0FRt3SRqqt1FBt/FBt_purity‚0.9375 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 +jet/accuracy_3_of_5‚0.09372751414775848 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 0"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚ 0.2578125 jet/accuracy_5_of_7‚0 7 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.3613886535167694 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9133334159851074 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 ("Purity/*FRt3SRqqt1FBt/event_purity‚0 9"Purity/1FRt0SRqqt1FBt/event_purity‚0.3159862458705902 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6040322780609131 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.22343264520168304 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 *jet/accuracy_1_of_5‚0.9563212990760803 particle/accuracy_5_of_6‚1 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.27025413513183594 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 9"Purity/1FRt*SRqqt0FBt/event_purity‚0.1017458438873291 ;"Purity/3FRt*SRqqt1FBt/event_purity‚0.024242425337433815 particle/accuracy_2_of_4‚1 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.30000001192092896 :"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.43886157870292664 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 ( Purity/4FRt1SRqqt0FBt/FRt_purity‚0.5 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.3737908601760864 9"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.4197896420955658 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.025681568309664726 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.25170668959617615 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.44042131304740906 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5602050423622131 ;"Purity/3FRt*SRqqt*FBt/event_purity‚0.008192525245249271 *jet/accuracy_2_of_5‚0.4751370847225189 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.30000001192092896 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6764705777168274 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.20000000298023224 + Purity/0FRt3SRqqt*FBt/FBt_purity‚0.9375 ( Purity/4FRt1SRqqt*FBt/FRt_purity‚0.5 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 9"Purity/*FRt*SRqqt1FBt/event_purity‚0.4218382239341736 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9879381656646729 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 <"Purity/2FRt*SRqqt0FBt/event_purity‚0.0067478809505701065 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 jet/accuracy_6_of_6‚0 jet/accuracy_2_of_7‚0.5 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5086805820465088 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9870370030403137 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 6 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.920634925365448 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6666666865348816 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9854983687400818 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 :"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.32464098930358887 8"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.472222238779068 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6497535109519958 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_4_of_5‚1 particle/accuracy_5_of_7‚1 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.017499366775155067 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.19126905500888824 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.3587987422943115 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.7380952835083008 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9902248978614807 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6043831706047058 :"Purity/2FRt*SRqqt1FBt/event_purity‚0.02604139968752861 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7938596606254578 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 :"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.40772393345832825 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.20339415967464447 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4728260934352875 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5353187322616577 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.40709033608436584 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.20919892191886902 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 7 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.2060053050518036 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 + Purity/1FRt*SRqqt3FBt/FRt_purity‚0.6875 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4094387888908386 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 :"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.44257789850234985 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 jet/accuracy_5_of_6‚0 _runtime‚6088.512381815 7 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.2003604918718338 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6785714030265808 8 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.24270352721214294 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 particle/accuracy_2_of_6‚1 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 7 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.3615344166755676 particle/accuracy_4_of_7‚1 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 8 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.33988338708877563 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.40168699622154236 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.017777778208255768 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.19813115894794464 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.15625 8 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.25099846720695496 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 8 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.36897045373916626 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 'particle/f_score‚0.4146517515182495 ) Purity/*FRt4SRqqt*FBt/FRt_purity‚0.25 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9934912323951721 *loss/val_total_loss‚37.523191992865634 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4539106786251068 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ) Purity/*FRt4SRqqt0FBt/FRt_purity‚0.25 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.40958112478256226 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.38435089588165283 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.02500000037252903 particle/accuracy_1_of_1‚1 0"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚ 0.2421875 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03787878900766373 *jet/accuracy_1_of_2‚0.7225202918052673 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9942372441291809 :"Purity/1FRt2SRqqt1FBt/event_purity‚0.01105990819633007 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1785714328289032 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.18896450102329254 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0034164944663643837 <"Purity/2FRt1SRqqt0FBt/event_purity‚0.0037220846861600876 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5704324245452881 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 :"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.43847841024398804 +jet/accuracy_2_of_3‚0.24233025312423706 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.05000000074505806 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 particle/accuracy_3_of_5‚1 8"Purity/0FRt1SRqqt0FBt/event_purity‚0.370488703250885 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 particle/accuracy_1_of_2‚1 jet/accuracy_3_of_7‚0 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 epoch‚8 6 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.998720109462738 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.40239959955215454 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.014174938201904297 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 particle/accuracy_1_of_4‚1 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.7380952835083008 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.25641027092933655 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.11999999731779099 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9691274762153625 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.3222222328186035 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.15750393271446228 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 9"Purity/1FRt*SRqqt2FBt/event_purity‚0.0958222970366478 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.5687075257301331 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ("Purity/0FRt3SRqqt*FBt/event_purity‚0 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.22549018263816833 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 *jet/accuracy_3_of_4‚0.0622410774230957 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3333333730697632 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4753086566925049 & Purity/1FRt*SRqqt4FBt/FRt_purity‚0 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 particle/accuracy_1_of_7‚1 & Purity/1FRt0SRqqt4FBt/FRt_purity‚0 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2340448647737503 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9996017217636108 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5644542574882507 6 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.200576052069664 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.20987656712532043 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3958333432674408 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 ,jet/accuracy_4_of_5‚0.017893576994538307 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 ) Purity/4FRt*SRqqt*FBt/FRt_purity‚0.25 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 ,jet/accuracy_4_of_4‚0.008940337225794792 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 ) Purity/4FRt*SRqqt0FBt/FRt_purity‚0.25 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4052121341228485 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 7 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.1935099959373474 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3753200173377991 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.19305555522441864 particle/accuracy_7_of_7‚1 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5280947089195251 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 9"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.7083333134651184 +jet/accuracy_1_of_1‚0.43586286902427673 particle/accuracy_6_of_7‚1 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 8 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.49358975887298584 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9982088804244995 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5083056688308716 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 ;"Purity/2FRt1SRqqt*FBt/event_purity‚0.004274473991245031 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8128120303153992 ;"Purity/0FRt2SRqqt1FBt/event_purity‚0.021633384749293327 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 :"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.37460318207740784 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.18893417716026306 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.30000001192092896 9"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.4285714328289032 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 <"Purity/1FRt2SRqqt0FBt/event_purity‚0.0011947430903092027 & Purity/2FRt2SRq×Ý*ñâqt*FBt/FBt_purity‚1 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9928166270256042 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 6validation_average_jet_accuracy‚0.4092567265033722 particle/accuracy_3_of_6‚1 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.019838441163301468 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 9"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.4115765392780304 particle/accuracy_2_of_5‚1 (particle/accuracy‚0.8499610424041748 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 jet/accuracy_7_of_7‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9903018474578857 8"Purity/*FRt0SRqqt3FBt/event_purity‚0.130952388048172 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9917144775390625 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2081986516714096 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 8 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.24285154044628143 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.45394736528396606 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 :"Purity/1FRt*SRqqt1FBt/event_purity‚0.17496971786022186 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.24077165126800537 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 9"Purity/0FRt*SRqqt2FBt/event_purity‚0.2680545449256897 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2757529318332672 8"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.694444477558136 +jet/accuracy_2_of_4‚0.35239291191101074 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 jet/accuracy_6_of_7‚0 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 7 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.1984456479549408 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3056703209877014 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.038851648569107056 9"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.3888888657093048 8"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.370488703250885 :"Purity/0FRt1SRqqt2FBt/event_purity‚0.06361111253499985 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22963403165340424 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 :"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.42916232347488403 8 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.31046995520591736 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9919471144676208 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.22343264520168304 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.07758620381355286 8 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.27710333466529846 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.35555046796798706 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 8 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.31111109256744385 jet/accuracy_1_of_7‚1 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 9"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.4279382526874542 ("Purity/*FRt3SRqqt*FBt/event_purity‚0 9"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.5180565118789673 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9980034232139587 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4052627682685852 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 9"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.4410784840583801 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 9"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.4285714328289032 _step‚440 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 9"Purity/*FRt1SRqqt*FBt/event_purity‚0.1728462129831314 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9975894093513489 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.33560606837272644 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3399544358253479 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 ,jet/accuracy_3_of_3‚0.026387574151158333 7 Purity/1FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9479166865348816 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 7 Purity/1FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204¸­YïÔ”Ô‚(:‰ Õ¶èԊг¬ gpu.0.gpu‚22.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0žmÕ‚(:â Õ¶èÔ‘æଠdisk.sdb.in‚9.453125 disk.sdb2.in‚9.453125 disk.sda1.out‚0 disk.sda2.out‚706.1982421875 disk.md0.in‚ 67.2421875 disk.md0.out‚ 680.37890625) proc.memory.availableMB‚ 1200.73046875* proc.memory.percent‚18.830537796020508 cpu‚25.784849991362925 disk.rbd0.in‚0) disk./.usagePercent‚83.23905626675851$ disk./.usageGB‚2977.031841278076 disk.sda2.in‚ 57.7890625 disk.dm-0.in‚ 253.3671875 network.sent‚ 1.1910307e+07 disk.sdb1.out‚0! disk.nvme0n1.out‚ 38864.671875" proc.memory.rssMB‚ 3085.1953125 disk.sda.in‚ 57.7890625 disk.sda.out‚706.1982421875 disk.sda1.in‚0# memory_percent‚92.6713228225708 proc.cpu.threads‚17 network.recv‚ 1.963801e+06 disk.rbd2.in‚0# disk.nvme1n1.out‚37115.69140625 disk.sdb.out‚706.1982421875 disk.md0p1.in‚ 67.2421875 disk.rbd2.out‚ 1.68359375 disk.nvme0n1.in‚ 220.91015625 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.out‚706.1982421875 disk.md0p1.out‚ 680.37890625 disk.rbd0.out‚ 1.68359375 disk.dm-0.out‚75980.36328125 disk.sdb1.in‚0ćɌ2Ö- _wandbruntime‚6104  _runtime‚6104Ž,ÏŠÇ×Á ' lr-AdamW/pg1‚3.4549643663889784e-05 ' lr-AdamW/pg2‚3.4549643663889784e-05 trainer/global_step‚5449 # _timestamp‚1.78848445217587e+09 _runtime‚6104.286272162 _step‚441¦¶V—ÌØÆ ' lr-AdamW/pg1‚3.4549643663889784e-05 ' lr-AdamW/pg2‚3.4549643663889784e-05 trainer/global_step‚5449 # _timestamp‚1.78848445217587e+09 _runtime‚6104.286272162 _step‚441¹!+D72Ù- _wandbruntime‚6104  _runtime‚6104÷*i õ'ÚïO \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 120936508 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 219775378 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 % _timestamp‚1.7884844521772382e+09 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚748889458717696 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 219752104 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚748889475757056 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚742049045027533 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚754880206849024 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚442 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 trainer/global_step‚5449 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6490441390080 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚98838870 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚754881007365120 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚61539594 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚649792063689728 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚61539597 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009UŸ¥›ú'ÛôO QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 120913236 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚736077591604464 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 5990748131328 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6490441390080 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚98838870 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚754881007365120 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚61539594 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚649792063689728 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚61539597 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 120936508 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 219775378 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 % _timestamp‚1.7884844521772382e+09 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚748889458717696 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 219752104 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚748889475757056 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚742049045027533 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚754880206849024 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 _step‚442 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 trainer/global_step‚5449 JDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5972499129243 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 219814544 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6491594148864 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚736208241805504 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚90008895 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚649907541189120 =7DeviceStatsMonitor.on_train_batch_end/n5ñ\“Tum_alloc_retries‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚98856322 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚755014825029120 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚98856322 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6491750182912 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚61550354 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚742180757974107 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚736208258844864 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5991814470144 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 % _timestamp‚1.7884844532553782e+09 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚98856320 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚749022227068928 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚749022210029568 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚61550357 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 _step‚443 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚98856320 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚643415766102528 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚28458541 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 219791244 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚643415791006208 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚755014825029120 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚28459045 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 120958222 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 120958222 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚742179959452655 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0D±c7'àÿM ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚90009402 BDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 5992597960192 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚755014024499712 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 5972499129243 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 219814544 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 156034048 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6491594148864 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚736208241805504 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚90008895 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚649907541189120 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 REDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚98856322 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚755014825029120 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚98856322 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6491750182912 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚61550354 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚742180757974107 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚736208258844864 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 5991814470144 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 % _timestamp‚1.7884844532553782e+09 J=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚98856320 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚749022227068928 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚749022210029568 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚61550357 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 _step‚443 PDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚98856320 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚643415766102528 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚28458541 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 219791244 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚643415791006208 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚755014825029120 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚28459045 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 120958222 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 120958222 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚742179959452655 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚761571117211648 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚649008837347328 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 221712456 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚748633920996597 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _runtime‚6162.585980364 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚655556774884352 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚748634719517841 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚90778310 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚755527024311296 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚520 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 221735730 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 122024260 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 % _timestamp‚1.7884845104715292e+09 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚742610118695824 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 _step‚446 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚62077597 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚649008812443648 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6023819340133 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚755527041350656 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚62077594 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244„Pb$û'ïõO YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 L?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚99711468 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 PCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚99711470 TGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚99711470 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚742610101656464 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚755527041350656 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚761571917727744 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚523 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6044092900352 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6044092900352 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚90778833 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 trainer/global_step‚5499 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6044876377088 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚520 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 221735730 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 122024260 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 % _timestamp‚1.7884845104715292e+09 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 160241664 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚742610118695824 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 _step‚446 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚62077597 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚649008812443648 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6023819340133 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚755527041350656 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚62077594 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚761571917727744 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚761571117211648 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6547962440704 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 122000988 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 122000988 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 122024260 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚755527024311296 PCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚99711468 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚28701236 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚655556960029696 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 185145344 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 6024600822017 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚761571117211648 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚649008837347328 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 221712456 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚748633920996597 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 _runtime‚6162.585980364 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚655556774884352 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚748634719517841 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚90778310 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚755527024311296 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 221751596 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚90794554 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚649122981150208 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚447 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚742740751857504 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚761705735391744 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚748766432464415 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6025663567551 % _timestamp‚1.7884845115359328e+09 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚655672076221440 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 122022676 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 122022676 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚526 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚755659792662528 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6024882085459 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚755659792662528 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6045942729216 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚99728922 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚99728920 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚755659775623168 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6549273911808 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 221774896 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚755659775623168 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚90794028 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6549119974912 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚523 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 221751596 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 _runtime‚6163.647285491 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 221751596 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚90794554 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚649122981150208 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _step‚447 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚742740751857504 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚761705735391744 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚748766432464415 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6025663567551 % _timestamp‚1.7884845115359328e+09 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚655672076221440 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 122022676 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 122022676 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚526 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚755659792662528 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6024882085459 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚755659792662528 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6045942729216 NADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚99728922 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 NADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚99728920 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚755659775623168 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6549273911808 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 221774896 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚755659775623168 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚90794028 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6549119974912 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚523 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 221751596 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 _runtime‚6163.647285491 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peaE&^Aòk‚ 22113464320 PDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚768262027574272 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 123112012 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 123088740 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚28948966 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 100584070 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 100584068 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚762164606944256 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6097437669376 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚91564029 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚755219595486905 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6605750447616 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚749142611708464 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 % _timestamp‚1.7884845694080062e+09 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚62615594 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚768262027574272 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚91564563 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚6221.518826464 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚450 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 123112012 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6098221146112 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚661321601182208 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 223696082 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚768262828090368 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6076983778441 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚762164589904896 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚28948435 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚749142628747824 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚768262828090368 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚768262027574272 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚91564563 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _runtime‚6221.518826464 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 _step‚450 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 G>DeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 123112012 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6098221146112 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚661321601182208 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 223696082 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚768262828090368 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6076983778441 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚762164589904896 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚28948435 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚749142628747824 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚768262828090368 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚768262027574272 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 123112012 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 123088740 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚28948966 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 100584070 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 100584068 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚762164606944256 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚534 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6097437669376 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚91564029 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚755219595486905 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6605750447616 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚749142611708464Â3Üæc2„- _wandbruntime‚6222  _runtime‚6222Ìÿú …þM [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6078828005859 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚661436896291328 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6606908032000 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6078046523767 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 100601522 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚28953930 _step‚451 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 100601522 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 100601520 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚755352106954723 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6099287498240 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚762297341216768 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 123110428 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚91579779 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6098504008192 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 trainer/global_step‚5549 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 223735248 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚28953425 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚654830146390528 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚762297358256128 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚62626354 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚768395845224960 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 223711948 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 _runtime‚6222.601984008 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 123133726 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚762297341216768 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚508 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚654830171294208 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 223735248 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚768396645754368 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚768396645754368 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚755351308433271 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2U¶ '†ƒN REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚62626354 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚768395845224960 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 223711948 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 _runtime‚6222.601984008 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 123133726 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚762297341216768 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚508 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚654830171294208 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 223735248 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚768396645754368 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚768396645754368 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚755351308433271 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 158131200 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6078828005859 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚661436896291328 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6606908032000 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6078046523767 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 100601522 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚28953930 _step‚451 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 100601522 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 100601520 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 P8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚755352106954723 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6099287498240 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚762297341216768 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 123110428 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 BDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚91579779 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6098504008192 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 trainer/global_step‚5549 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 223735248 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚28953425 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚654830146390528 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚762297358256128 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309ÃG«)2‡- _wandbruntime‚6222  _runtime‚6222LOýWˆÑ 2loss/SRqqt1/assignment_loss‚0.8852484652290603 2loss/SRqqt4/assignment_loss‚1.3603447658025611 1loss/SRqqt1/detection_loss‚0.9949932696649453 .loss/FBt3/detection_loss‚2.451398015022278 % _timestamp‚1.7884845704931755e+09 _step‚452 1loss/FBt3/assignment_loss‚0.12079154307605222 /loss/FBt2/detection_loss‚1.6585404896422435 /loss/FRt3/assignment_loss‚3.501482583822743 2loss/SRqqt3/assignment_loss‚1.6889257652219385 .loss/FRt2/detection_loss‚1.830307069434119 1loss/SRqqt2/detection_loss‚1.1036290579986188 0loss/SRqqt3/detection_loss‚2.287617470137775 1loss/FBt4/assignment_loss‚0.19570383723012696 .loss/FRt1/detection_loss‚1.576754399567333 -loss/FRt3/detection_loss‚2.83053290363281 .loss/FRt4/detection_loss‚2.185266050154466 0loss/FRt1/assignment_loss‚1.3407816188967125 /loss/FRt2/assignment_loss‚1.848295841898237 2loss/SRqqt2/assignment_loss‚1.2346897804358554 -loss/FBt4/detection_loss‚2.42161450907588 epoch‚9 trainer/global_step‚5549 /loss/FRt4/assignment_loss‚2.991256383749155 1loss/FBt1/assignment_loss‚0.11071568531984435 2loss/FBt2/assignment_loss‚0.023173960541582442 0loss/SRqqt4/detection_loss‚2.384044152700295 _runtime‚6222.603341444 /loss/FBt1/detection_loss‚0.5940313258189198 %loss/total_loss‚37.62013894407355­aò\‰Ö %loss/total_loss‚37.62013894407355 2loss/SRqqt1/assignment_loss‚0.8852484652290603 2loss/SRqqt4/assignment_loss‚1.3603447658025611 1loss/SRqqt1/detection_loss‚0.9949932696649453 .loss/FBt3/detection_loss‚2.451398015022278 % _timestamp‚1.7884845704931755e+09 _step‚452 1loss/FBt3/assignment_loss‚0.12079154307605222 /loss/FBt2/detection_loss‚1.6585404896422435 /loss/FRt3/assignment_loss‚3.501482583822743 2loss/SRqqt3/assignment_loss‚1.6889257652219385 .loss/FRt2/detection_loss‚1.830307069434119 1loss/SRqqt2/detection_loss‚1.1036290579986188 0loss/SRqqt3/detection_loss‚2.287617470137775 1loss/FBt4/assignment_loss‚0.19570383723012696 .loss/FRt1/detection_loss‚1.576754399567333 -loss/FRt3/detection_loss‚2.83053290363281 .loss/FRt4/detection_loss‚2.185266050154466 0loss/FRt1/assignment_loss‚1.3407816188967125 /loss/FRt2/assignment_loss‚1.848295841898237 2loss/SRqqt2/assignment_loss‚1.2346897804358554 -loss/FBt4/detection_loss‚2.42161450907588 epoch‚9 trainer/global_step‚5549 /loss/FRt4/assignment_loss‚2.991256383749155 1loss/FBt1/assignment_loss‚0.11071568531984435 2loss/FBt2/assignment_loss‚0.023173960541582442 0loss/SRqqt4/detection_loss‚2.384044152700295 _runtime‚6222.603341444 /loss/FBt1/detection_loss‚0.5940313258189198ÄV dD•Š‚(:Š Ü·èÔ¯Àž« gpu.0.gpu‚50.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Õ|¶p‹‚(:å Ü·èÔž–ÿ¬ disk.sda1.out‚0 disk.nvme0n1.in‚ 220.91015625 disk.sda2.in‚ 57.7890625! disk.sda2.out‚722.14208984375 cpu‚25.77738867782972 disk.md0.out‚ 695.7109375 disk.rbd2.out‚ 1.68359375" disk.nvme0n1.out‚ 39538.6640625 disk.sdb2.in‚9.453125 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚ 695.7109375 disk.rbd2.in‚0$ memory_percent‚92.68252849578857* proc.memory.percent‚18.830537796020508 disk.nvme1n1.in‚ 32.45703125 network.sent‚ 1.2291344e+07) proc.memory.availableMB‚ 1198.89453125$ disk./.usageGB‚2976.764446258545 disk.sdb1.out‚0# disk.nvme1n1.out‚37792.98828125 disk.sdb.in‚9.453125 disk.md0.in‚ 67.2421875" proc.memory.rssMB‚ 3085.1953125 network.recv‚ 2.003767e+06 disk.sda.out‚722.14208984375 disk.sda1.in‚0 disk.sdb.out‚722.14208984375! disk.sdb2.out‚722.14208984375 disk.dm-0.out‚77331.65234375) disk./.usagePercent‚83.23157979009889 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875 proc.cpu.threads‚17 disk.rbd0.out‚ 1.68359375 disk.sdb1.in‚0 disk.sda.in‚ 57.7890625´@%|žŒ‚(:“ ë·èԈÄ« gpu.0.gpu‚75.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚226.141' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚56.53524999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0C#ÈÞr‚(:ç ë·èÔ Œ×« disk.md0.in‚ 67.2421875 disk.rbd0.out‚ 1.68359375 disk.sdb.out‚724.00341796875! disk.sdb2.out‚724.00341796875) proc.memory.availableMB‚ 1198.81640625* proc.memory.percent‚18.830537796020508 network.recv‚ 2.009261e+06 disk.sda1.in‚0! disk.sda2.out‚724.00341796875$ memory_percent‚92.68300533294678 disk.nvme0n1.in‚ 220.91015625 disk.md0p1.in‚ 67.2421875 cpu‚25.776617497084086 disk.sda.in‚ 57.7890625 disk.sdb.in‚9.453125 disk.sda2.in‚ 57.7890625 disk.md0.out‚ 697.51171875 disk.md0p1.out‚ 697.51171875 disk.sdb1.out‚0 proc.cpu.threads‚17( disk./.usagePercent‚83.2350892415873$ disk./.usageGB‚2976.889961242676 disk.sda.out‚724.00341796875 disk.dm-0.out‚ 77505.1015625 disk.sdb1.in‚0 disk.nvme1n1.in‚ 32.45703125# disk.nvme1n1.out‚37844.01171875 disk.rbd0.in‚0 network.sent‚ 1.2368065e+07 disk.sda1.out‚0# disk.nvme0n1.out‚39661.08984375 disk.rbd2.out‚ 1.68359375" proc.memory.rssMB‚ 3085.1953125 disk.dm-0.in‚ 253.3671875 disk.rbd2.in‚0 disk.sdb2.in‚9.453125.¡d“Ž‚(:ˆ ú·èÔÇ“Ž« gpu.0.gpu‚44.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚196.906' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚49.2265 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ì7™m‚(:â ú·èÔŸµ¤¬) proc.memory.availableMB‚ 1198.81640625 network.sent‚ 1.2373206e+07 disk.sda.in‚ 57.7890625 disk.sda.out‚725.7080078125 disk.sda2.out‚725.7080078125 disk.md0.out‚ 699.16796875 disk.rbd2.in‚0 network.recv‚ 2.012831e+06 disk.sdb.in‚9.453125 disk.rbd0.in‚0" proc.memory.rssMB‚ 3085.1953125 disk.nvme0n1.in‚ 220.91015625 disk.sdb2.out‚725.7080078125 disk.dm-0.in‚ 253.3671875 disk.rbd2.out‚ 1.68359375 cpu‚25.775873385900532 proc.cpu.threads‚17 disk.sda1.in‚0 disk.sda1.out‚0" disk.nvme1n1.out‚ 37920.4921875 disk.sdb1.out‚0$ memory_percent‚92.68300533294678$ disk./.usageGB‚2976.889450073242 disk.sdb.out‚725.7080078125 disk.md0p1.out‚ 699.16796875' disk./.usagePercent‚83.235074949076# disk.nvme0n1.out‚39722.45703125 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.453125 disk.md0.in‚ 67.2421875 disk.md0p1.in‚ 67.2421875 disk.sdb1.in‚0* proc.memory.percent‚18.830537796020508 disk.sda2.in‚ 57.7890625 disk.rbd0.out‚ 1.68359375 disk.dm-0.out‚77642.94921875Ŭh¨”‚(:‰ ‰¸èÔ­¼‡« gpu.0.gpu‚17.0 gpu.0.memory‚5, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0]n‹n‘‚(:ã ‰¸èÔ䊗¬ disk.dm-0.out‚ 77755.140625) proc.memory.availableMB‚ 1198.73046875 network.recv‚ 2.017952e+06$ disk./.usageGB‚2976.889507293701 disk.rbd0.in‚0 disk.rbd2.out‚ 1.68359375 disk.sdb.in‚9.453125! disk.sdb2.out‚727.80419921875 disk.md0.in‚ 67.2421875 disk.rbd0.out‚ 1.68359375 disk.sdb1.in‚0# memory_percent‚92.6835298538208" proc.memory.rssMB‚ 3085.1953125" disk.nvme0n1.out‚ 39783.6953125 disk.sdb2.in‚9.453125 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.91015625 disk.md0p1.out‚ 701.19140625 cpu‚25.775099163015383 proc.cpu.threads‚17 disk.sdb.out‚727.80419921875) disk./.usagePercent‚83.23507654898398 disk.sda.out‚727.80419921875 disk.nvme1n1.in‚ 32.45703125 disk.sda2.in‚ 57.7890625 disk.sdb1.out‚0 network.sent‚ 1.237982e+07 disk.sda1.in‚0! disk.sda2.out‚727.80419921875* proc.memory.percent‚18.830537796020508 disk.sda.in‚ 57.7890625 disk.sda1.out‚0" disk.nvme1n1.out‚ 37971.4453125 disk.md0.out‚ 701.19140625 disk.md0p1.in‚ 67.2421875 disk.dm-0.in‚ 253.3671875‡rq2’- _wandbruntime‚6280  _runtime‚6280SÉ“Ã ' lr-AdamW/pg2‚1.9320564217484858e-05 trainer/global_step‚5599 % _timestamp‚1.7884846282196348e+09 _runtime‚6280.330070804 _step‚453 ' lr-AdamW/pg1‚1.9320564217484858e-05M4ÿ+Î”È _runtime‚6280.330070804 _step‚453 ' lr-AdamW/pg1‚1.9320564217484858e-05 ' lr-AdamW/pg2‚1.9320564217484858e-05 trainer/global_step‚5599 % _timestamp‚1.7884846282196348e+09Å|Øk2•- _wandbruntime‚6280  _runtime‚6280Ž4›Pÿ–ôO KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚774952937936896 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚768802155498496 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 124199764 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 6130929698633 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚761806068498457 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚768802172537856 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚667086431610368 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚774953738452992 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚755675138799824 _step‚454 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 124199764 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6150782438400 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 101456670 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_trainµµ¦÷û_batch_start/segment.small_pool.current‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 225633160 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6151565915136 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 % _timestamp‚1.7884846282212715e+09 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6130148216749 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚660423192731648 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚768802155498496 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 124176492 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1^fX|ÿ'—ùO VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚774953738452992 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚755675138799824 _step‚454 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 124199764 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6150782438400 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 101456670 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 225633160 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6151565915136 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚516 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 % _timestamp‚1.7884846282212715e+09 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6130148216749 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚660423192731648 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚768802155498496 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 124176492 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚774952937936896 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚768802155498496 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 124199764 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 6130929698633 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚761806068498457 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚768802172537856 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚667086431610368 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0Æ.'42˜- _wandbruntime‚6281  _runtime‚6281r§'™þM MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚667201908765184 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚29202677 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 101474122 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚92366523 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6664387098624 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 _runtime‚6281.400257724 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚63164357 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 225695600 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 225672300 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6151848777216 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29202169 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 _step‚455 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6152632267264 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6131210962075 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 124221478 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚775087556116992 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 225695600 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 trainer/global_step‚5599 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6152632267264 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚660537361438208 % _timestamp‚1.7884846292889981e+09 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 124198180 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6151848777216 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 124221478 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚92367034 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚511 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚775086755587584 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚761936982923579 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚755805789000864 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 124198180 FDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 101474122 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚755805771961504 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚768934906810368 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚775087556116992 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6664547326976 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476(>­šƒN [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 101474120 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 101474122 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚755805771961504 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚768934906810368 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚775087556116992 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6664547326976 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚667201908765184 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚29202677 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 101474122 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚92366523 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 EDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6664387098624 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 PDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 _runtime‚6281.400257724 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚63164357 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 225695600 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 225672300 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6151848777216 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29202169 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 _step‚455 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6152632267264 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6131210962075 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 124221478 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚775087556116992 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 225695600 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 trainer/global_step‚5599 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6152632267264 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚660537361438208 % _timestamp‚1.7884846292889981e+09 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 124198180 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 UCDevi³â¢¶\ceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6151848777216 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 124221478 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚92367034 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚511 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚508 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚775086755587584 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚761936982923579 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚755805789000864 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 124198180 FDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚63691594 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6721095972352 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚768391742988765 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚775439721092096 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 125287516 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚549 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚781643848299520 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6204127207424 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚762207648851824 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 125264244 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 % _timestamp‚1.7884846876633976e+09 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚762207631812464 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6204127207424 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚93137746 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 trainer/global_step‚5649 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚63691597 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚775439738131456 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 227593512 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 227616786 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚775439738131456 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6204910684160 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚29446152 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 102329270 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 102329268 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 _runtime‚6339.777953775 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6183312655057 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚775439721092096 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚666130407779328 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6720935730688ž$ÿ'«ùO ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚775439738131456 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6204910684160 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚29446152 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 102329270 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 102329268 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 _runtime‚6339.777953775 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6183312655057 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚775439721092096 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚666130407779328 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6720935730688 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚781644648815616 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚29446698 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚63691594 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6721095972352 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚768391742988765 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚775439721092096 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 125287516 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚549 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚781643848299520 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6204127207424 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚762207648851824 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 125264244 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 % _timestamp‚1.7884846876633976e+09 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚762207631812464 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6204127207424 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚93137746 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 trainer/global_step‚5649 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚63691597 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚775439738131456 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 227593512 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 227616786Ê´Bº2¬- _wandbruntime‚6340  _runtime‚6340VSŽj­ýM F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6205977036288 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 VIDeviceStatsMonitor.on_traiú¹ÛÔü$n_batch_end/inactive_split.large_pool.allocated‚63702357 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 125309230 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 125285932 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 trainer/global_step‚5649 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6722239382528 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6205193546240 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚781778466479616 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 102346720 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6722081251328 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚93153534 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚538 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6184375400383 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚775572489443328 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚762338282013504 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 227655952 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 227632652 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚768523455935339 % _timestamp‚1.7884846887294242e+09 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚541 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 102346722 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚672966790964736 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚666244551582208 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _runtime‚ 6340.84096103 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29451180 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354ßè×'®‚N SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 125309230 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 125285932 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 trainer/global_step‚5649 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 E8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6722239382528 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6205193546240 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚781778466479616 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 102346720 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6722081251328 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚93153534 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚538 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6184375400383 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚775572489443328 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚762338282013504 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 227655952 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 227632652 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚768523455935339 % _timestamp‚1.7884846887294242e+09 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚541 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 102346722 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 183034880 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚672966790964736 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚666244551582208 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 _runtime‚ 6340.84096103 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29451180 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6205977036288 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚63702357 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400ËõÃÛð2¯- _wandbruntime‚6340  _runtime‚6340Ç[>aa°Û _step‚460 2loss/SRqqt3/assignment_loss‚1.6717936128910098 1loss/FBt4/assignment_loss‚0.33861513517601655 0loss/FBt3/assignment_loss‚0.6465214625027553 .loss/FRt4/detection_loss‚2.184368728294863 trainer/global_step‚5649 2loss/SRqqt1/assignment_loss‚0.9379323564756376 /loss/FRt3/detection_loss‚3.0033699784960066 .loss/FBt4/detection_loss‚2.000178195812084 /loss/FBt1/detection_loss‚0.6721401633991999 /loss/FBt3/detection_loss‚2.5407032715646842 0loss/FRt1/assignment_loss‚1.5674692820966913 0loss/FRt4/assignment_loss‚3.2750490314903713 2loss/SRqqt2/assignment_loss‚1.1517411614014537 1loss/FBt1/assignment_loss‚0.09020131038113559 1loss/SRqqt1/detection_loss‚0.9265825467040906 2loss/SRqqt4/assignment_loss‚1.4554870091783612 1loss/SRqqt3/detection_loss‚2.2006727627345493 epoch‚9 % _timestamp‚1.7884846887321231e+09 3loss/FBt2/assignment_loss‚0.0029050667474143665 1loss/SRqqt2/detection_loss‚1.0771572267733558 %loss/total_loss‚37.42949519856387 .loss/FBt2/detection_loss‚1.382087092101574 /loss/FRt2/detection_loss‚1.6981307931044805 0loss/FRt2/assignment_loss‚1.5334031384970461 0loss/FRt3/assignment_loss‚2.9541885735733167 /loss/FRt1/detection_loss‚1.6037126735815506 1loss/SRqqt4/detection_loss‚2.5150846255862196 _runtime‚6340.842228006óf±à 2loss/SRqqt1/assignment_loss‚0.9379323564756376 /loss/FRt3/detection_loss‚3.0033699784960066 .loss/FBt4/detection_loss‚2.000178195812084 /loss/FBt1/detection_loss‚0.6721401633991999 /loss/FBt3/detection_loss‚2.5407032715646842 0loss/FRt1/assignment_loss‚1.5674692820966913 0loss/FRt4/assignment_loss‚3.2750490314903713 2loss/SRqqt2/assignment_loss‚1.1517411614014537 1loss/FBt1/assignment_loss‚0.09020131038113559 1loss/SRqqt1/detection_loss‚0.9265825467040906 2loss/SRqqt4/assignment_loss‚1.4554870091783612 1loss/SRqqt3/detection_loss‚2.2006727627345493 epoch‚9 % _timestamp‚1.7884846887321231e+09 3loss/FBt2/assignment_loss‚0.0029050667474143665 1loss/SRqqt2/detection_loss‚1.0771572267733558 %loss/total_loss‚37.42949519856387 .loss/FBt2/detection_loss‚1.382087092101574 /loss/FRt2/detection_loss‚1.6981307931044805 0loss/FRt2/assignment_loss‚1.5334031384970461 0loss/FRt3/assignment_loss‚2.9541885735733167 /loss/FRt1/detection_loss‚1.6037126735815506 1loss/SRqqt4/detection_loss‚2.5150846255862196 _runtime‚6340.842228006 _step‚460 2loss/SRqqt3/assignment_loss‚1.6717936128910098 1loss/FBt4/assignment_loss‚0.33861513517601655 0loss/FBt3/assignment_loss‚0.6465214625027553 .loss/FRt4/detection_loss‚2.184368728294863 trainer/global_step‚5649Ì…}n7•²‚(:Š Ô¸èÔ…ÁÒ¬ gpu.0.gpu‚88.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚117.525' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.38125 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0^šª³l³‚(:á Ô¸èÔ‘•Š­# disk.nvme0n1.out‚40212.38671875# disk.nvme1n1.out‚38353.53515625 disk.sdb.in‚9.453125 disk.sdb2.in‚9.453125 disk.md0.out‚ 709.61328125 disk.md0p1.out‚ 709.61328125 disk.rbd2.in‚0 disk.sdb1.out‚0$ disk./.usageGB‚2976.614730834961 disk.sda.in‚ 57.7890625 disk.sda.out‚736.5283203125" proc.memory.rssMB‚ 3085.1953125 disk.sda1.in‚0 disk.sdb2.out‚736.5283203125 disk.md0p1.in‚ 67.2421875 disk.rbd0.in‚0 disk.sda1.out‚0 disk.dm-0.in‚ 253.3671875$ memory_percent‚92.67778396606445' proc.memory.availableMB‚ 1199.671875 disk.nvme0n1.in‚ 220.91015625 disk.dm-0.out‚ 78565.921875 disk.rbd2.out‚ 1.68359375 network.sent‚ 1.2500082e+07 network.recv‚ 2.039328e+06) disk./.usagePercent‚83.22739368419472 disk.md0.in‚ 67.2421875 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚736.5283203125 disk.rbd0.out‚ 1.68359375* proc.memory.percent‚18.830537796020508 proc.cpu.threads‚17 disk.sda2.in‚ 57.7890625 disk.sda2.out‚736.5283203125 disk.sdb1.in‚0 cpu‚25.771192284465194\ £°”´‚(:‰ ã¸èԠΗ« gpu.0.gpu‚66.0 gpu.0.memory‚11, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.966' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.9915 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0o ´Ãdµ‚(:Ù ã¸èÔû—£¬ disk.nvme1n1.in‚ 32.45703125! disk.sdb2.out‚738.50732421875 disk.md0.out‚ 711.515625 disk.sda1.out‚0$ memory_percent‚92.67783164978027$ disk./.usageGB‚2976.614459991455 cpu‚25.77040678689961 network.sent‚ 1.2574471e+07 disk.sdb2.in‚9.453125 disk.md0p1.in‚ 67.2421875" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17 disk.sda.out‚738.50732421875 disk.nvme1n1.out‚38396.5 disk.sdb.out‚738.50732421875 disk.md0.in‚ 67.2421875 disk.sdb1.in‚0 disk.nvme0n1.in‚ 220.91015625( proc.memory.availableMB‚ 1199.6640625 disk.dm-0.out‚ 78670.2734375 disk.rbd2.in‚0 network.recv‚ 2.04475e+06 disk.sdb.in‚9.453125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875 disk.rbd2.out‚ 1.68359375" disk.nvme0n1.out‚ 40273.7734375) disk./.usagePercent‚83.22738611129694 disk.md0p1.out‚ 711.515625 disk.rbd0.out‚ 1.68359375 disk.sda1.in‚0 disk.sda2.in‚ 57.7890625! disk.sda2.out‚738.50732421875 disk.sdb1.out‚0 disk.sda.in‚ 57.7890625* proc.memory.percent‚18.830537796020508,yOË“¶‚(:ˆ ò¸èÔû‹š« gpu.0.gpu‚8.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚37.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Ç—õ^·‚(:Ó ò¸èÔÿòˆ¬ disk.nvme0n1.in‚ 220.91015625 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.in‚9.453125' proc.memory.availableMB‚ 1199.671875 network.sent‚ 1.258179e+07% disk./.usageGB‚2976.6377487182617 disk.md0p1.out‚ 712.9453125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875 disk.dm-0.out‚78732.48828125 disk.sda.out‚ 740.0078125 disk.sda1.in‚0 disk.rbd0.out‚ 1.68359375 disk.sdb1.in‚0 disk.sda.in‚ 57.7890625" disk.nvme0n1.out‚ 40335.1171875# disk.nvme1n1.out‚38397.37109375 disk.sdb.in‚9.453125 disk.sdb2.out‚ 740.0078125* proc.memory.percent‚18.830537796020508 network.recv‚ 2.048085e+06) disk./.usagePercent‚83.22803727384554 disk.sda1.out‚0 disk.sda2.in‚ 57.7890625 disk.md0p1.in‚ 67.2421875$ memory_percent‚92.67778396606445 disk.sda2.out‚ 740.0078125 disk.md0.out‚ 712.9453125 disk.rbd2.in‚0 proc.cpu.threads‚17 disk.sdb.out‚ 740.0078125 cpu‚25.76961992767965 disk.md0.in‚ 67.2421875" proc.memory.rssMB‚ 3085.1953125 disk.rbd2.out‚ 1.68359375 disk.sdb1.out‚0Š­L•¸‚(:Š ¹èÔÝë—« gpu.0.gpu‚73.0 gpu.0.memory‚18, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚39.0 gpu.0.powerWatts‚189.769' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚47.44225 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ÃT×Ëf¹‚(:Û ¹èÔ¾·ÿ« disk.sdb2.out‚ 741.607421875 disk.md0.out‚ 714.484375 disk.md0p1.out‚ 714.484375 disk.dm-0.out‚78864.51171875$ memory_percent‚92.67780780792236" proc.memory.rssMB‚ 3085.1953125 disk.nvme1n1.in‚ 32.45703125 disk.sdb1.out‚0 disk.sda1.in‚0! disk.nvme1n1.out‚ 38468.140625 disk.rbd0.out‚ 1.68359375 disk.rbd2.out‚ 1.68359375 disk.sdb1.in‚0 disk.sda.out‚ 741.607421875) proc.memory.availableMB‚ 1199.66796875# disk.nvme0n1.out‚40396.37109375 disk.sdb2.in‚9.453125 disk.md0.in‚ 67.2421875 disk.sdb.out‚ 741.607421875 disk.sda1.out‚0 disk.sda2.in‚ 57.7890625 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875 proc.cpu.threads‚17 network.sent‚ 1.2586268e+07 network.recv‚ 2.053039e+06) disk./.usagePercent‚83.22809209735905% disk./.usageGB‚2976.6397094726562 disk.md0p1.in‚ 67.2421875 disk.sdb.in‚9.453125 disk.sda2.out‚ 741.607421875 disk.rbd2.in‚0 disk.sda.in‚ 57.7890625* proc.memory.percent‚18.830537796020508 cpu‚25.76887446765556 disk.nvme0n1.in‚ 220.91015625Š(°92º- _wandbruntime‚6398  _runtime‚6398¥ú¼É»Ã ' lr-AdamW/pg1‚1.1577038066220797e-05 ' lr-AdamW/pg2‚1.1577038066220797e-05 trainer/global_step‚5699 % _timestamp‚1.7884847460611098e+09 _runtime‚6398.172237208 _step‚461¼Ó¿iÎ¼È _step‚461 ' lr-AdamW/pg1‚1.1577038066220797e-05 ' lr-AdamW/pg2‚1.1577038066220797e-05 trainer/global_step‚5699 % _timestamp‚1.7884847460611098e+09 _runtime‚6398.172237208ÍqéÚ#2½- _wandbruntime‚6398  _runtime‚6398;{–¥¾ôO [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6258255453184 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 103201870 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6236477093365 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚782077286685696 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚93926136 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6778811505152 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 229577138 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚671837597923328 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚768740141864464 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚678616409428480 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚678616226380288 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 trainer/global_step‚5699 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6257471976448 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚543 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6258255453184 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 229553864 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚7883347586621†µr¯U44 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚782077303725056 _step‚462 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6778653360640 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 126351996 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 126375268 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 126375268 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚782077286685696 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚6398.176040576 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚93925593 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 103201868 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚788335559178240 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6257471976448 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚671837573019648 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚64229594 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 103201868 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚64229597 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 % _timestamp‚1.7884847460622835e+09 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚788334758662144 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚540 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚768740158903824 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0wÅÿ'¿ùO M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 103201868 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚788335559178240 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6257471976448 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚671837573019648 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚64229594 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 103201868 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚64229597 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 % _timestamp‚1.7884847460622835e+09 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚788334758662144 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚540 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚768740158903824 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6258255453184 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 103201870 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6236477093365 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚782077286685696 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚93926136 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 183048192 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6778811505152 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 229577138 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚671837597923328 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚768740141864464 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚678616409428480 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚678616226380288 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 trainer/global_step‚5699 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6257471976448 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚543 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6258255453184 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 229553864 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚788334758662144 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚782077303725056 _step‚462 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6778653360640 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 126351996 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 126375268 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 126375268 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚782077286685696 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 _runtime‚6398.176040576 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚93925593 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1ÎÒ+22À- _wandbruntime‚6399  _runtime‚6399­ kF'ÁüM UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚782210055036928 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚768870809104864 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6237539838691 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 _runtime‚6399.257322985 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 103219322 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚788468576312832 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6779812106752 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚93941813 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚524 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 103219320 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 229616304 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚782210037997568 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 229593004 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚782210055036928 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚671951716822528 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6779966043648 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29700935 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚768870792065504 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6259321805312 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 B8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚782210037997568 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 126373684 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 229593004 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 126373684 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 229616304 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚64240354 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚678731528929280 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚775108331904195 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 103219322 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚93941289 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6258538315264 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚521 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 # _timestamp‚1.78848474714632e+09 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0ηUÂN VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚64240357 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6258538315264 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚671951741726208 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚782210037997568 FDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 126373684 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 229593004 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 126373684 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 EDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 229616304 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚64240354 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚678731528929280 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚775108331904195 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 103219322 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚93941289 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6258538315264 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚521 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 # _timestamp‚1.78848474714632e+09 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚782210055036928 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 N>DeviceStatsMonitor.on_train_batchq›¾š²_end/requested_bytes.all.peak‚ 22511104841 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚768870809104864 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6237539838691 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 _runtime‚6399.257322985 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 103219322 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚788468576312832 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6779812106752 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚93941813 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚524 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 103219320 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 229616304 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚782210037997568 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 229593004 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚782210055036928 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚671951716822528 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6779966043648 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29700935 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚768870792065504 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6259321805312 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 BDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 _step‚466 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 104074468 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚94714358 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6311600222208 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚528 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚29947289 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚788714852279296 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚94714886 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 231514216 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚795025669024768 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚788714869318656 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚684381381499904 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚677544788067328 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6310816745472 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚788714852279296 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6289641531673 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 104074468 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174659584 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚64767597 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚781562293448137 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 127463020 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚29946764 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚775272651916464 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚788714869318656 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 231537490 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 127439748 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 127463020 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚677544763163648 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚795025669024768 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 104074470 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚684381206840320 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6311600222208 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚795026469540864 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚781563091969381 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 104074470 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6310816745472 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚64767594 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 % _timestamp‚1.7884848054085193e+09 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚775272668955824 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752oš*§ï"ÓùO QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 104074468 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚94714358 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6311600222208 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚528 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚29947289 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚788714852279296 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚94714886 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 231514216 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚795025669024768 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚788714869318656 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚684381381499904 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚677544788067328 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6310816745472 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚788714852279296 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6289641531673 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 104074468 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 174659584 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚64767597 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚781562293448137 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 127463020 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚29946764 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚775272651916464 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚788714869318656 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 231537490 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 127439748 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 127463020 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚677544763163648 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚795025669024768 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 104074470 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚684381206840320 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6311600222208 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚795026469540864 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚781563091969381 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 104074470 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6310816745472 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.—ðL2freed‚64767594 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 149755904 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 % _timestamp‚1.7884848054085193e+09 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚775272668955824 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 _step‚466Òô/2Ô- _wandbruntime‚6458  _runtime‚6458ëD7Á'ÕþM WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚64778354 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 231576656 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚788847620630528 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 104091920 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 127484734 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚64778357 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚519 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 231553356 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚29952211 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚775403319156864 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 FDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 104091922 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6311883084288 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6312666574336 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚94730046 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 % _timestamp‚1.7884848064762356e+09 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 104091920 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚788847603591168 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 231553356 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6291485759091 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _runtime‚6458.587731228 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚788847620630528 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6311883084288 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚795160287204864 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚94730568 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 trainer/global_step‚5749 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚795159486675456 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29951692 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6837755431424 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6312666574336 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792™ôÞ 'ÖƒN P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚781694006394503 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚775403302117504 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚795160287204864 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 127461436 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚522 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 127484734 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚684496510558208 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 104091922 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6311883084288 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6312666574336 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚94730046 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 % _timestamp‚1.7884848064762356e+09 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 104091920 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚788847603591168 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 231553356 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6291485759091 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 _runtime‚6458.587731228 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚788847620630528 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6311883084288 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚795160287204864 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚94730568 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 trainer/global_step‚5749 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚795159486675456 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚29951692 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 176743424 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6837755431424 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6312666574336 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚64778354 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 231576656 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚788847620630528 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 104091920 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 127484734 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚64778357 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚519 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 231553356 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚29952211 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚775403319156864 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 FDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚801716579387392 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6364944991232 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6364161514496 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 104947068 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚795352417872896 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚80171657938739uDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 233497842 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 128550772 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 128527500 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6342805969981 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚788147967938445 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚683251978211328 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚683251953307648 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚801716579387392 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6364944991232 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6364161514496 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 104947068 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚795352417872896 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚801716579387392 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6894074700800 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 _step‚470 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 128527500 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 104947070 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚30195707 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 _runtime‚6508.165913242 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 233474568 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6364944991232 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚788148766459689 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚795352417872896 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚65305597 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚795352434912256 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 104947068 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 104947070 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚30195193 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 233497842 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 128550772 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 128527500 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6342805969981 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚788147967938445 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚683251978211328 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚683251953307648 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 _runtime‚6508.989106873 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚95517128 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 233513708 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 104964520 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 128549188 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚690261499881472 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚781935812169504 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 128572486 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚95516607 % _timestamp‚1.7884848568782818e+09 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 104964522 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 128572486 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚518 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 233537008 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚801851197567488 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 233513708 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6366011343360 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚801850397038080 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30200253 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚788279680884811 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 _step‚471 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚795485169184768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752Ÿç‹ßèƒN XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚690261312652288 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6344650197399 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6365227853312 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚30200771 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 162325504 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚788280479406263 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6365227853312 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 trainer/global_step‚5799 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6366011343360 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 6895377867264 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 104964522 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚801851197567488 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚521 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 _runtime‚6508.989106873 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚95517128 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 233513708 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 104964520 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 128549188 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚690261499881472 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚781935812169504 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 128572486 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚95516607 % _timestamp‚1.7884848568782818e+09 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 104964522 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 128572486 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚518 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 233537008 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 WCDeviceStatsMonitor.on_train_batch_end/allocatg{л*ed_bytes.all.allocated‚801851197567488 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 233513708 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6366011343360 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚801850397038080 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30200253 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚788279680884811 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 _step‚471 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚795485169184768 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 BDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 PDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚808407489750016 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 105819670 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 105819668 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884849068398132e+09 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _step‚474 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6418289760256 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚695911103399424 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6417506283520 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚65843594 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6395970408289 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 129615252 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6418289760256 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚801989983466496 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚688959143451648 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚794733642428753 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 129638524 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚794734440949997 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 105819668 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚30444620 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚808408290266112 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚96288214 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6951783191040 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 235434920 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚801990000505856 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 _runtime‚ 6558.9528517 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚788337672020464 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6417506283520 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚801989983466496 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 235458194 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚96288738 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6951935044096 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚5849 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0¤Æl`!ù÷O TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚808407489750016 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚801990000505856 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 JDeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚808407489750016 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 105819670 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 105819668 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 % _timestamp‚1.7884849068398132e+09 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 _step‚474 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6418289760256 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚695911103399424 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6417506283520 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚65843594 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6395970408289 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 129615252 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6418289760256 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚801989983466496 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚688959143451648 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 JDeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚794733642428753 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 129638524 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚794734440949997 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 105819668 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚30444620 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 VBDeviceStatsMonitor.on_train_batch_start/active_bytes.all.allocated‚808408290266112 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚96288214 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 6951783191040 F8DeviceStatsMonitor.on_train_batch_start/active.all.freed‚ 235434920 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚801990000505856 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 _runtime‚ 6558.9528517 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚524 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚788337672020464 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6417506283520 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚801989983466496 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 235458194 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚96288738 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚521 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 LDDeviceStatsMonitoŽäšr.on_train_batch_start/segment.small_pool.allocated‚476 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 6951935044096 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚5849 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 129638524 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚65843597 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚30445141 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚808408290266112 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352Úž<~É2ú- _wandbruntime‚6559  _runtime‚6559OÖÍ'ûþM L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚802122751817728 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 105837122 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 129636940 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 129636940 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 105837120 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚794866153896571 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 235497360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 _step‚475 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚96303951 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚523 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6418572622336 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚802122734778368 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 105837122 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚802122734778368 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚808541307400704 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚5849 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚696026410007040 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6419356112384 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚808542107930112 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 235474060 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚696026231166464 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚808542107930112 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚65854354 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6397033153615 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6419356112384 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30449597 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6952943911936 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚802122751817728 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 105837120 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 129660238 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 235474060 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 EDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚96303951 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚523 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 BDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6418572622336 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚802122734778368 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 105837122 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚802122734778368 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚808541307400704 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 trainer/global_step‚5849 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚696026410007040 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 RDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.peak‚ 998244352 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6419356112384 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚808542107930112 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 235474060 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚696026231166464 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚808542107930112 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚65854354 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 153936896 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 178840576 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6397033153615 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6419356112384 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30449597 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 6952943911936 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚802122751817728 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 105837120 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 129660238 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 C=DeviceStatsMonitor.on_train_batch_end/oversize_segments.freed‚0 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 235474060 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 EDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚802122751817728 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 105837122 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 129636940 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 129636940 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 105837120 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚794866153896571 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 235497360 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 _step‚475 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476ÛeýÓ2ý- _wandbruntime‚6559  _runtime‚6559ýTÿYþÓ 0loss/FRt1/assignment_loss‚1.5640261477894253 2loss/SRqqt3/assignment_loss‚1.3638378601325185 /loss/FRt3/detection_loss‚2.8642588473599533 1loss/SRqqt2/detection_loss‚1.0903880198251956 _step‚476 1loss/SRqqt4/detection_loss‚2.4169952593066477 /loss/FBt1/detection_loss‚0.6415627752225298 .loss/FRt4/assignment_loss‚3.40185990641194 2loss/SRqqt1/assignment_loss‚1.0636959059446869 2loss/FBt2/assignment_loss‚0.025369227769775342 /loss/FRt4/detection_loss‚2.1283067247457303 1loss/SRqqt1/detection_loss‚0.8870771906541702 $ _timestamp‚1.788484907682237e+09 /loss/FRt3/assignment_loss‚2.921700951354257 1loss/SRqqt2/assignment_loss‚1.076229430517258 /loss/FRt1/detection_loss‚1.8288233601798614 /loss/FRt2/detection_loss‚1.9111294717205545 ,loss/FBt2/detection_loss‚1.6167290860689 .loss/FBt4/detection_loss‚2.118853058665991 trainer/global_step‚5849 0loss/FRt2/assignment_loss‚1.8548070650834303 2loss/SRqqt4/assignment_loss‚1.6083142752674493 2loss/FBt1/assignment_loss‚0.058753144654925024 /loss/FBt3/assignment_loss‚0.164002423721382 1loss/FBt4/assignment_loss‚0.35835085705911257 0loss/SRqqt3/detection_loss‚2.437509976458131 .loss/FBt3/detection_loss‚2.201381573210592 &loss/total_loss‚37.603962539124424 epoch‚9 _runtime‚6559.792257185§sið^ÿØ 1loss/SRqqt1/detection_loss‚0.8870771906541702 $ _timestamp‚1.788484907682237e+09 /loss/FRt3/assignment_loss‚2.921700951354257 1loss/SRqqt2/assignment_loss‚1.076229430517258 /loss/FRt1/detection_loss‚1.8288233601798614 /loss/FRt2/detection_loss‚1.9111294717205545 ,loss/FBt2/detection_loss‚1.6167290860689 .loss/FBt4/detection_loss‚2.118853058665991 trainer/global_step‚5849 0loss/FRt2/assignment_loss‚1.8548070650834303 2loss/SRqqt4/assignment_loss‚1.6083142752674493 2loss/FBt1/assignment_loss‚0.058753144654925024 /loss/FBt3/assignment_loss‚0.164002423721382 1loss/FBt4/assignment_loss‚0.35835085705911257 0loss/SRqqt3/detection_loss‚2.437509976458131 .loss/FBt3/detection_loss‚2.201381573210592 &loss/total_loss‚37.603962539124424 epoch‚9 _runtime‚6559.792257185 0loss/FRt1/assignment_loss‚1.5640261477894253 2loss/SRqqt3/assignment_loss‚1.3638378601325185 /loss/FRt3/detection_loss‚2.8642588473599533 1loss/SRqqt2/detection_loss‚1.0903880198251956 _step‚476 1loss/SRqqt4/detection_loss‚2.4169952593066477 /loss/FBt1/detection_loss‚0.6415627752225298 .loss/FRt4/assignment_loss‚3.40185990641194 2loss/SRqqt1/assignment_loss‚1.0636959059446869 2loss/FBt2/assignment_loss‚0.025369227769775342 /loss/FRt4/detection_loss‚2.1283067247457303ÜŽié•€‚(:Š µºèÔ…àÁ© gpu.0.gpu‚74.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚117.193' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.29825 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0fçù³l‚(:á µºèÔËç« disk.sda.in‚ 57.7890625 disk.nvme1n1.in‚ 32.45703125$ memory_percent‚92.67899990081787 proc.cpu.threads‚17" disk.nvme1n1.out‚ 39224.5703125 disk.sdb.in‚9.453125 disk.md0.out‚ 733.96484375 disk.dm-0.in‚ 253.3671875 disk.rbd2.out‚ 1.68359375 disk.sdb1.in‚0 disk.sda1.out‚0! disk.nvme0n1.out‚ 41071.328125 disk.sdb2.out‚761.8115234375 disk.md0p1.in‚ 67.2421875 cpu‚25.76064599486417 network.sent‚ 1.2911191e+07 disk.sdb1.out‚0 disk.sda2.in‚ 57.7890625) disk./.usagePercent‚83.21099889380228 disk.rbd0.out‚ 1.68359375 disk.sda1.in‚0 disk.sda2.out‚761.8115234375" proc.memory.rssMB‚ 3085.1953125 disk.rbd0.in‚0 disk.dm-0.out‚ 80295.8984375 disk.sdb.out‚761.8115234375 disk.md0p1.out‚ 733.96484375 disk.nvme0n1.in‚ 220.91015625 disk.md0.in‚ 67.2421875) proc.memory.availableMB‚ 1199.47265625% disk./.usageGB‚2976.0283737182617 disk.rbd2.in‚0 disk.sda.out‚761.8115234375 disk.sdb2.in‚9.453125* proc.memory.percent‚18.830537796020508 network.recv‚ 2.105222e+06dè;•‚‚(:Š ĺèÔáÇ« gpu.0.gpu‚86.0 gpu.0.memory‚21, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚116.583' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚29.14575 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0f]Klƒ‚(:á ĺèÔÌ‚ç« network.sent‚ 1.2986419e+07 disk.md0.out‚ 735.35546875 disk.md0p1.out‚ 735.35546875 disk.sda.out‚763.2744140625 network.recv‚ 2.109593e+06 disk.sdb2.in‚9.453125 disk.sdb2.out‚763.2744140625 disk.sda2.in‚ 57.7890625 disk.rbd0.out‚ 1.68359375 disk.rbd2.in‚0 disk.sdb1.in‚0$ memory_percent‚92.67745018005371# disk.nvme1n1.out‚39224.66796875 disk.sdb1.out‚0( proc.memory.availableMB‚ 1199.7265625" proc.memory.rssMB‚ 3085.1953125 disk.sdb.in‚9.453125 disk.sda2.out‚763.2744140625 disk.md0p1.in‚ 67.2421875 disk.rbd0.in‚0 disk.sda.in‚ 57.7890625 disk.sda1.in‚0) disk./.usagePercent‚83.21103953146502 disk.md0.in‚ 67.2421875 disk.rbd2.out‚ 1.68359375* proc.memory.percent‚18.830537796020508 cpu‚25.759975933727414 disk.sdb.out‚763.2744140625 disk.sda1.out‚0# disk./.usageGB‚2976.02982711792 disk.dm-0.out‚80446.37109375! disk.nvme0n1.out‚ 41221.703125 proc.cpu.threads‚17 disk.nvme1n1.in‚ 32.45703125 disk.dm-0.in‚ 253.3671875 disk.nvme0n1.in‚ 220.91015625%ºÚa”„‚(:‰ ÓºèÔÕøª gpu.0.gpu‚51.0 gpu.0.memory‚9, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚223.585' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.89625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0¤ÓË—n…‚(:ã ÓºèÔË„é« disk.sda.in‚ 57.7890625 disk.sdb2.in‚9.453125 cpu‚25.759237542218997 network.recv‚ 2.114271e+06! disk.sdb2.out‚765.29833984375! disk.sda2.out‚765.29833984375 disk.md0p1.in‚ 67.2421875 disk.rbd0.out‚ 1.68359375$ memory_percent‚92.67740249633789 disk.rbd2.out‚ 1.68359375# disk.nvme0n1.out‚41298.01171875 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚765.29833984375 disk.md0p1.out‚ 737.296875 disk.dm-0.out‚ 80522.7734375 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sdb.in‚9.453125 disk.md0.in‚ 67.2421875 disk.rbd0.in‚0) disk./.usagePercent‚83.21453447712106% disk./.usageGB‚2976.1548233032227 disk.dm-0.in‚ 253.3671875 disk.md0.out‚ 737.296875 disk.rbd2.in‚0 disk.nvme0n1.in‚ 220.91015625' proc.memory.availableMB‚ 1199.734375" proc.memory.rssMB‚ 3085.1953125 disk.sdb1.in‚0 disk.sda1.out‚0 disk.sda2.in‚ 57.7890625 proc.cpu.threads‚17 network.sent‚ 1.2992871e+07 disk.sda.out‚765.29833984375# disk.nvme1n1.out‚39224.76171875* proc.memory.percent‚18.830537796020508ã«È2†- _wandbruntime‚6609  _runtime‚6609þ½ÄèLJÁ & lr-AdamW/pg1‚1.984689743873141e-06 & lr-AdamW/pg2‚1.984689743873141e-06 trainer/global_step‚5899 % _timestamp‚1.7884849576473203e+09 _runtime‚6609.757725397 _step‚477hºPbÌˆÆ trainer/global_step‚5899 % _timestamp‚1.7884849576473203e+09 _runtime‚6609.757725397 _step‚477 & lr-AdamW/pg1‚1.984689743873141e-06 & lr-AdamW/pg2‚1.984689743873141e-06Ý‚s2‰- _wandbruntime‚6609  _runtime‚6609 M®Í ŠóO A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 106692270 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚815098400112640 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 130726276 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 130703004 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 130703004 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 7009746541056 trainer/global_step‚5899 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 M/]M¹7?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 106692268 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 106692270 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚701676080136704 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚694666333595648 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚808627566099456 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚808627549060096 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 $ _timestamp‚1.788484957648264e+09 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚808627549060096 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6470851052544 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147658752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚97076305 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚30694708 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚808627566099456 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 237418546 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚528 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _step‚478 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6471634529280 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚66381594 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚815098400112640 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚694666358499328 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚801319316919061 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚701676252699136 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 7009894199808 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚97075777 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6470851052544 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6449134846597 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752ð‚B^þ'‹øO ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6449134846597 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 106692270 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚815098400112640 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 A8DeviceStatsMonitor.on_train_batch_start/segment.all.peak‚1785 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 BDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 QCDeviceStatsMonitor.on_train_batch_start/active.small_pool.allocated‚ 130726276 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 130703004 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 130703004 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚525 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 7009746541056 trainer/global_step‚5899 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 N@DeviceStatsMonitor.on_train_batch_start/active_bytes.all.current‚ 800516096 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 106692268 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 106692270 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 172562432 ZFDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.freed‚701676080136704 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚694666333595648 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚808627566099456 \HDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.freed‚808627549060096 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 $ _timestamp‚1.788484957648264e+09 YEDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.freed‚808627549060096 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6470851052544 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 147658752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 KBDeviceStatsMonitor.on_train_batch_start/segment.large_pool.current‚1309 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚97076305 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 TGDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.current‚17039360 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚30694708 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚808627566099456 WJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.current‚17039360 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 237418546 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 JBDeviceStatsMonitor.on_train_batch_start/inactive_split.all.current‚528 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 _step‚478 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 [LDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.peak‚ 2911223808 [IDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.allocated‚ 6471634529280 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚66381594 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.peak‚ 998244352 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚815098400112640 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚694666358499328 UADeviceStatsMonitor.on_train_batch_start/requested_bytes.all.freed‚801319316919061 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚701676252699136 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 7009894199808 G?DeviceStatsMonitor.on_train_batch_start/segment.small_pool.peak‚476 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚97075777 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 KADeviceStatsMonitor.on_train_batch_start/active.small_pool.current‚23272 ZHDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.freed‚ 6470851052544 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0Þyˆ«2Œ- _wandbruntime‚6610  _runtime‚66106 ,='þM LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _step‚479 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 7011060518912 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6471917391360 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 237434412 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 BDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚66392354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30699287 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚30699796 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6472700881408 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚694780477398528 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚815233018292736 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚66392357 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6450979074015 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚815233018292736 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 130747990 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884849585703743e+09 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚815232217763328 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 130724692 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 237457712 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 237434412 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 106709720 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚701791562821120 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚701791383980544 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚801451828386879 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚694780502302208 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 106709722 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚97092153 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚97091641 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚808760317411328 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 237457712 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚808760300371968 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 106709720“´#ærŽƒN TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 _runtime‚6610.681287614 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 7010906582016 D>DeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚66392354 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30699287 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚30699796 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6472700881408 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚694780477398528 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 T@DeviceStatsMonitor.on_train_batch_end/active_bytes.all.allocated‚815233018292736 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚512 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚66392357 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6450979074015 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚815233018292736 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 MGDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.current‚3 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 FDeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 130747990 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 % _timestamp‚1.7884849585703743e+09 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚815232217763328 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 130724692 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚509 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 237457712 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 237434412 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 106709720 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚701791562821120 XDDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.freed‚701791383980544 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚801451828386879 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚694780502302208 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 106709722 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚97092153 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.curre˜¿äs—nt‚ 798521452 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 PDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚97091641 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚808760317411328 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 237457712 ZFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.freed‚808760300371968 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 106709720 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 _step‚479 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 EDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 UHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.current‚17039360 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 7011060518912 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6471917391360 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 237434412 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚821789310475264 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6502299284905 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 131790756 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚97865710 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚801402709163824 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 107564868 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 239378898 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚544 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚801402692124464 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 131814028 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 _runtime‚6663.378831954 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6524195821568 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 107564870 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 131790756 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚66919597 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚807905789930613 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 7067526022144 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚821789310475264 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚815265131693056 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚707441074665472 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 trainer/global_step‚5949 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚821790110991360 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 107564868 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚97865163 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚700373523739648 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 BDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚821789310475264 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 JDeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6502299284905 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 131790756 UGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.peak‚ 977437696 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚97865710 H?DeviceStatsMonitor.on_train_batch_start/segment.large_pool.peak‚1309 M=DeviceStatsMonitor.on_train_batch_start/active_bytes.all.peak‚ 22941488640 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚801402709163824 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 158144512 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 107564868 H>DeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 F=DeviceStatsMonitor.on_train_batch_start/segment.all.allocated‚1785 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 N@DeviceStatsMonitor.on_train_batch_start/allocation.all.allocated‚ 239378898 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚544 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚801402692124464 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 131814028 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 _runtime‚6663.378831954 E;DeviceStatsMonitor.on_train_batch_start/allocation.all.peak‚28433 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MDDeviceStatsMonitor.on_train_batch_start/segment.large_pool.allocated‚1309 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 WEDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.freed‚ 6524195821568 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 107564870 QCDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.freed‚ 131790756 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚66919597 =7DeviceStatsMonitor.on_train_batch_start/num_device_free‚0 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚807905789930613 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 7067526022144 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚821789310475264 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚815265131693056 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 ^JDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.allocated‚707441074665472 TDDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.allocated‚ 25797066752 trainer/global_step‚5949 WGDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.peak‚ 22113464320 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚821790110991360 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 107564868 KBDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.peak‚3354 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 D;DeviceStatsMonitoråÆÒÂè.on_train_batch_start/segment.all.current‚1785 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚97865163 aMDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.freed‚700373523739648 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 BDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 239418064 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30950552 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6526045650432 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚518 _runtime‚6664.378499637 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚97881424 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚707556367632896 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚821923128125952 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚30951067 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 107582320 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185132032 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 107582322 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 107582320 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 trainer/global_step‚5949 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚821923928655360 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚700487667542528 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 7068514958336 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚808037502877187 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6504143512323 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚66930354 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚815397883004928 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚97880906 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6526045650432 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚700487692446208 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6503362030231 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 7068675186688 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6525262160384 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 131835742 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 239394764 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚801533342325504 _step‚483 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 131812444 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚66930357 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 4.DeviceStatsMonitor.on_train_batch_end/num_ooms‚0 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚815397883004928 =7DeviceStatsMonitor.on_train_batch_end/num_alloc_retries‚0 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 F8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 FDeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 239418064 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚30950552 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 P@DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.current‚ 25797066752 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 RBDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.peak‚ 22113464320 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6526045650432 D>DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 H@DeviceStatsMonitor.on_train_batch_end/inactive_split.all.current‚518 _runtime‚6664.378499637 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚97881424 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚707556367632896 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚821923128125952 UEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.peak‚ 22113464320 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 160228352 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚30951067 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 107582320 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 185132032 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 YIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.allocated‚ 24798822400 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 107582322 PDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocation.large_pool.freed‚ 107582320 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 trainer/global_step‚5949 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.freed‚0 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚821923928655360 _KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.freed‚700487667542528 ]KDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.freed‚ 7068514958336 E?DeviceStatsMonitor.on_train_batch_end/oversize_allocations.peak‚0 WCDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.allocated‚808037502877187 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6504143512323 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚66930354 FDeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚815397883004928 K>DeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚97880906 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6526045650432 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚700487692446208 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 XFDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.freed‚ 6503362030231 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 7068675186688 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6525262160384 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 131835742 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 239394764ã”T-•2£- _wandbruntime‚6664  _runtime‚6664µ˜Â[^¤Ø /loss/FBt2/detection_loss‚1.5124836520602305 epoch‚9 0loss/FRt4/assignment_loss‚2.9940849045912423 /loss/FBt1/detection_loss‚0.6349173286714807 trainer/global_step‚5949 _step‚484 1loss/SRqqt2/detection_loss‚1.2111691756926428 1loss/SRqqt4/detection_loss‚2.0177707063655057 .loss/FBt3/detection_loss‚2.108201718992657 .loss/FBt4/detection_loss‚2.616392196793305 3loss/FBt2/assignment_loss‚0.0018656475324910894 1loss/FBt3/assignment_loss‚0.14523407899433494 /loss/FRt2/detection_loss‚1.8629355780193928 /loss/FRt3/assignment_loss‚2.905167075625637 2loss/SRqqt4/assignment_loss‚1.4262753790761862 2loss/SRqqt2/assignment_loss‚1.1002429050843645 2loss/SRqqt3/assignment_loss‚1.4076819163949594 $ _timestamp‚1.788485012270619e+09 _runtime‚6664.380819698 0loss/FBt4/assignment_loss‚0.1940537315300437 .loss/FRt1/detection_loss‚1.662689988849528 .loss/FRt3/detection_loss‚2.806940434271829 /loss/FRt4/detection_loss‚2.1103075663753166 1loss/SRqqt3/detection_loss‚2.6064106076955795 &loss/total_loss‚36.773463598412434 0loss/FRt1/assignment_loss‚1.5730871173822991 /loss/FRt2/assignment_loss‚1.765537597514965 1loss/FBt1/assignment_loss‚0.05761563602070335 2loss/SRqqt1/assignment_loss‚0.9971828564149581 1loss/SRqqt1/detection_loss‚1.0552157984627772ß|–4c¥Ý 1loss/SRqqt4/detection_loss‚2.0177707063655057 .loss/FBt3/detection_loss‚2.108201718992657 .loss/FBt4/detection_loss‚2.616392196793305 3loss/FBt2/assignment_loss‚0.0018656475324910894 1loss/FBt3/assignment_loss‚0.14523407899433494 /loss/FRt2/detection_loss‚1.8629355780193928 /loss/FRt3/assignment_loss‚2.905167075625637 2loss/SRqqt4/assignment_loss‚1.4262753790761862 2loss/SRqqt2/assignment_loss‚1.1002429050843645 2loss/SRqqt3/assignment_loss‚1.4076819163949594 $ _timestamp‚1.788485012270619e+09 _runtime‚6664.380819698 0loss/FBt4/assignment_loss‚0.1940537315300437 .loss/FRt1/detection_loss‚1.662689988849528 .loss/FRt3/detection_loss‚2.806940434271829 /loss/FRt4/detection_loss‚2.1103075663753166 1loss/SRqqt3/detection_loss‚2.6064106076955795 &loss/total_loss‚36.773463598412434 0loss/FRt1/assignment_loss‚1.5730871173822991 /loss/FRt2/assignment_loss‚1.765537597514965 1loss/FBt1/assignment_loss‚0.05761563602070335 2loss/SRqqt1/assignment_loss‚0.9971828564149581 1loss/SRqqt1/detection_loss‚1.0552157984627772 /loss/FBt2/detection_loss‚1.5124836520602305 epoch‚9 0loss/FRt4/assignment_loss‚2.9940849045912423 /loss/FBt1/detection_loss‚0.6349173286714807 trainer/global_step‚5949 _step‚484 1loss/SRqqt2/detection_loss‚1.2111691756926428äð~òx•¦‚(:Š ž»èÔí§’­ gpu.0.gpu‚38.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.357' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.83925 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Õ˜yGo§‚(:ä ž»èÔ⧮" proc.memory.rssMB‚ 3085.1953125 disk.nvme0n1.in‚ 220.91015625 disk.sda2.in‚ 57.7890625 disk.md0p1.in‚ 67.2421875 disk.dm-0.out‚81181.38671875 disk.rbd2.out‚ 1.6953125 disk.sda1.out‚0 network.recv‚ 2.135381e+06 disk.nvme1n1.in‚ 32.45703125 disk.md0.in‚ 67.2421875 disk.sdb1.in‚0 disk.sda.in‚ 57.7890625 disk.sda1.in‚0$ memory_percent‚92.67990589141846) proc.memory.availableMB‚ 1199.32421875 network.sent‚ 1.3100215e+07 disk.dm-0.in‚ 253.3671875 proc.cpu.threads‚17# disk.nvme1n1.out‚39225.80078125 disk.sdb.in‚9.453125 disk.rbd0.in‚0 disk.rbd2.in‚0 disk.sdb1.out‚0* proc.memory.percent‚18.830537796020508 cpu‚25.755985413670917" disk.nvme0n1.out‚ 41955.5859375 disk.md0p1.out‚ 745.3359375 disk.rbd0.out‚ 1.6953125) disk./.usagePercent‚83.23217452922601! disk.sdb2.out‚773.66845703125 disk.md0.out‚ 745.3359375 disk.sda.out‚773.66845703125$ disk./.usageGB‚2976.785717010498 disk.sdb.out‚773.66845703125 disk.sdb2.in‚9.453125! disk.sda2.out‚773.66845703125¨”¨‚(:‰ ­»èÔÌÈÄ« gpu.0.gpu‚46.0 gpu.0.memory‚12, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚40.0 gpu.0.powerWatts‚133.626' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚33.4065 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0ä9Xd©‚(:Ù ­»èÔ•‚Ô¬ disk.md0.out‚ 746.58984375( proc.memory.availableMB‚ 1199.3203125 network.recv‚ 2.141379e+06$ disk./.usageGB‚2976.784698486328 disk.sda.out‚ 774.986328125 disk.sda2.in‚ 57.7890625 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 746.58984375 disk.dm-0.out‚ 81319.0234375 disk.sda1.in‚0" disk.nvme1n1.out‚ 39225.9453125 disk.sdb2.in‚9.453125 disk.rbd0.out‚ 1.6953125 cpu‚25.75553928455046 disk.sdb1.out‚0 disk.sdb.in‚9.453125 disk.sda2.out‚ 774.986328125 disk.sdb1.in‚0 disk.dm-0.in‚ 253.3671875 disk.rbd2.in‚0$ memory_percent‚92.67992973327637 network.sent‚ 1.3187905e+07 disk.nvme1n1.in‚ 32.45703125 disk.md0p1.in‚ 67.2421875 disk.rbd2.out‚ 1.7578125" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17! disk.nvme0n1.out‚ 42093.078125) disk./.usagePercent‚83.23214605086393 disk.sda1.out‚0 disk.nvme0n1.in‚ 220.91015625 disk.rbd0.in‚0* proc.memory.percent‚18.830537796020508 disk.sda.in‚ 57.7890625 disk.sdb.out‚ 774.986328125 disk.sdb2.out‚ 774.986328125T‹ì›žª‚(:“ ¼»èÔ¡¿¾« gpu.0.gpu‚78.0 gpu.0.memory‚13, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚215.839' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚53.95974999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0>K.g«‚(:Ü ¼»èÔû„Ó« disk.rbd2.out‚ 1.7578125' proc.memory.availableMB‚ 1199.078125* proc.memory.percent‚18.830537796020508 cpu‚25.75512756900665 disk.sdb2.out‚777.3525390625 disk.sda2.in‚ 57.7890625 disk.md0.out‚ 748.8828125 network.sent‚ 1.3193033e+07) disk./.usagePercent‚83.22446521262479 disk.sda1.in‚0 disk.sda1.out‚0" disk.nvme0n1.out‚ 42230.6640625 disk.md0p1.in‚ 67.2421875 disk.sdb.in‚9.453125 disk.sdb2.in‚9.453125 disk.md0.in‚ 67.2421875 disk.sdb1.out‚0 disk.sda.in‚ 57.7890625 disk.nvme0n1.in‚ 220.91015625# disk.nvme1n1.out‚39226.10546875 disk.sda.out‚777.3525390625 proc.cpu.threads‚17$ disk./.usageGB‚2976.509994506836 disk.sda2.out‚777.3525390625 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875" proc.memory.rssMB‚ 3085.1953125 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.md0p1.out‚ 748.8828125 disk.rbd0.out‚ 1.7578125# memory_percent‚92.6814079284668 disk.nvme1n1.in‚ 32.45703125 disk.sdb.out‚777.3525390625 disk.dm-0.out‚81456.76953125 network.recv‚ 2.144572e+06†:Ɡ‚(:“ Ë»èÔÜØã© gpu.0.gpu‚70.0 gpu.0.memory‚16, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚224.527' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚56.13174999999999 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0•„2Ñj­‚(:ß Ë»èÔÊý‰«" disk.nvme0n1.out‚ 42395.8984375 disk.sdb2.in‚9.453125! disk.sdb2.out‚778.72998046875 disk.dm-0.out‚ 81622.0859375" proc.memory.rssMB‚ 3085.1953125) disk./.usagePercent‚83.23849597898327! disk.sda2.out‚778.72998046875 disk.md0.out‚ 750.19921875 disk.rbd0.out‚ 1.7578125 disk.sda.out‚778.72998046875& proc.memory.availableMB‚ 1198.84375# disk./.usageGB‚2977.01180267334 disk.nvme0n1.in‚ 220.91015625 disk.nvme1n1.out‚ 39226.1875 disk.sda2.in‚ 57.7890625 disk.md0.in‚ 67.2421875 disk.rbd2.in‚0 disk.sda.in‚ 57.7890625 disk.md0p1.in‚ 67.2421875 disk.sdb.out‚778.72998046875 disk.sdb1.in‚0 network.sent‚ 1.3199476e+07 disk.sda1.out‚0 disk.sdb.in‚9.453125 disk.md0p1.out‚ 750.19921875# memory_percent‚92.6828384399414 proc.cpu.threads‚17 disk.rbd2.out‚ 1.8369140625 disk.sda1.in‚0 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875* proc.memory.percent‚18.830537796020508 cpu‚25.754787258266873 disk.sdb1.out‚0 network.recv‚ 2.149239e+06@žÂ2®- _wandbruntime‚6720  _runtime‚6720 $Áȯ $ _timestamp‚1.788485068247548e+09 _runtime‚6720.362738337 _step‚485 ' lr-AdamW/pg1‚1.6789668563235735e-07 ' lr-AdamW/pg2‚1.6789668563235735e-07 trainer/global_step‚59991U6^Í°Ç ' lr-AdamW/pg1‚1.6789668563235735e-07 ' lr-AdamW/pg2‚1.6789668563235735e-07 trainer/global_step‚5999 $ _timestamp‚1.788485068247548e+09 _runtime‚6720.362738337 _step‚485å†0¬á2±- _wandbruntime‚6720  _runtime‚6720X¤GX²óO `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚821902697286656 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚706080738787328 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 7125053125632 _runtime‚6720.363343589 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚807935219215824 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚828480220837888 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 7125204978688 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 _step‚486 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚98653257 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 132878508 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚821902697286656 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 6556245205097 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚98653763 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚67457597 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚31196166 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚828480220837888 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 108437468 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚807935202176464 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 $ _timestamp‚1.788485068252156e+09 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 108437468 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750 A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚67457594 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚828481021353984 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 108437470 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚31195663 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚814491464420921 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6555463723213 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 108437470 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6578324067328 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 132901780%Ç«fþ'³øO A8DeviceStatsMonitor.on_train_batch_start/num_device_alloc‚1785 H?DeviceStatsMonitor.on_train_batch_start/inactive_split.all.peak‚1752 OIDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.current‚3 @:DeviceStatsMonitor.on_train_batch_start/num_oom_rejections‚0 GADeviceStatsMonitor.on_train_batch_start/oversize_segments.current‚0 WIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.current‚ 998244352 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.freed‚67457594 ?9DeviceStatsMonitor.on_train_batch_start/segment.all.freed‚0 YEDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.allocated‚828481021353984 QCDeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.current‚ 800516096 UGDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.allocated‚ 108437470 OEDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.current‚23272 TGDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.freed‚31195663 YEDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.allocated‚814491464420921 ZHDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.freed‚ 6555463723213 QCDeviceStatsMonitor.on_train_batch_start/active.large_pool.allocated‚ 108437470 ^LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.allocated‚ 6578324067328 UGDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.allocated‚ 132901780 `LDeviceStatsMonitor.on_train_batch_start/allocated_bytes.large_pool.allocated‚821902697286656 JDDeviceStatsMonitor.on_train_batch_start/oversize_allocations.current‚0 YIDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.current‚ 24798822400 YKDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.allocated‚ 998244352 JDeviceStatsMonitor.on_train_batch_start/active.large_pool.peak‚3354 eQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.allocated‚706080738787328 ?9DeviceStatsMonitor.on_train_batch_start/num_alloc_retries‚0 LFDeviceStatsMonitor.on_train_batch_start/oversize_allocations.allocated‚0 D>DeviceStatsMonitor.on_train_batch_start/oversize_segments.peak‚0 RBDeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.current‚ 25797066752 [KDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.allocated‚ 24798822400 O?DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.peak‚ 25797066752 D:DeviceStatsMonitor.on_train_batch_start/active.all.current‚23274 _MDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.freed‚ 7125053125632 _runtime‚6720.363343589 UGDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.current‚ 783476736 OFDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.peak‚1009 F@DeviceStatsMonitor.on_train_batch_start/segment.large_pool.freed‚0 ZLDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.peak‚ 286040064 `LDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.allocated‚807935219215824 F@DeviceStatsMonitor.on_train_batch_start/segment.small_pool.freed‚0 GADeviceStatsMonitor.on_train_batch_start/active.large_pool.current‚2 UADeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.freed‚828480220837888 JDeviceStatsMonitor.on_train_batch_start/active.small_pool.peak‚28166 QCDeviceStatsMonitor.on_train_batch_start/requested_bytes.all.current‚ 798521244 F@DeviceStatsMonitor.on_train_batch_start/reserved_bytes.all.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.freed‚0 MGDeviceStatsMonitor.on_train_batch_start/reserved_bytes.small_pool.freed‚0 RDDeviceStatsMonitor.on_train_batch_start/active_bytes.small_pool.peak‚ 977437696 \ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.large_pool.current‚24903680 cQDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.allocated‚ 7125204978688 XJDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.current‚ 781481884 _step‚486 LBDeviceStatsMonitor.on_train_batch_start/allocation.small_pool.peak‚28166 M@DeviceStatsMonitor.on_train_batch_start/inactive_split.all.freed‚98653257 HBDeviceStatsMonitor.on_train_batch_start/oversize_allocations.freed‚0 WJDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.current‚17039360 H>DeviceStatsMonitor.on_train_batch_start/allocation.all.current‚23274 VHDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.current‚ 176756736 TEDeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.all.peak‚ 3109853696 LDDeviceStatsMonitor.on_train_batch_start/segment.small_pool.allocated‚476 UGDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.peak‚ 975420792 M?DeviceStatsMonitor.on_train_batch_start/active.small_pool.freed‚ 132878508 TDDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.peak‚ 22113464320 XJDeviceStatsMonitor.on_train_batch_start/allocated_bytes.small_pool.current‚ 783476736 ]ODeviceStatsMonitor.on_train_batch_start/inactive_split_bytes.small_pool.current‚ 151853056 60DeviceStatsMonitor.on_train_batch_start/num_ooms‚0 WGDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.peak‚ 21653231616 ]IDeviceStatsMonitor.on_train_batch_start/active_bytes.large_pool.allocated‚821902697286656 KEDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.current‚2 QIDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.current‚503 GADeviceStatsMonitor.on_train_batch_start/oversize_allocations.peak‚0 E?DeviceStatsMonitor.on_train_batch_start/oversize_segments.freed‚0 ^LDeviceStatsMonitor.on_train_batch_start/requested_bytes.small_pool.allocated‚ 6556245205097 JBDeviceStatsMonitor.on_train_batch_start/segment.small_pool.current‚476 QDDeviceStatsMonitor.on_train_batch_start/inactive_split.all.allocated‚98653763 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.allocated‚67457597 XKDeviceStatsMonitor.on_train_batch_start/inactive_split.small_pool.allocated‚31196166 R>DeviceStatsMonitor.on_train_batch_start/active_bytes.all.freed‚828480220837888 P@DeviceStatsMonitor.on_train_batch_start/allocated_bytes.all.peak‚ 22941488640 =6DeviceStatsMonitor.on_train_batch_start/max_split_size‚-1 ICDeviceStatsMonitor.on_train_batch_start/oversize_segments.allocated‚0 D;DeviceStatsMonitor.on_train_batch_start/segment.all.current‚1785 QCDeviceStatsMonitor.on_train_batch_start/allocation.large_pool.freed‚ 108437468 \HDeviceStatsMonitor.on_train_batch_start/requested_bytes.large_pool.freed‚807935202176464 A7DeviceStatsMonitor.on_train_batch_start/active.all.peak‚28433 P@DeviceStatsMonitor.on_train_batch_start/requested_bytes.all.peak‚ 22511104841 VFDeviceStatsMonitor.on_train_batch_start/reserved_bytes.large_pool.peak‚ 24798822400 $ _timestamp‚1.788485068252156e+09 M?DeviceStatsMonitor.on_train_batch_start/active.large_pool.freed‚ 108437468 NFDeviceStatsMonitor.on_train_batch_start/inactive_split.large_pool.peak‚750æÊ¢g,2´- _wandbruntime‚6721  _runtime‚6721Ê?Ž'µþM OADeviceStatsMonitor.on_train_batch_end/active.small_pool.allocated‚ 132923494 I?DeviceStatsMonitor.on_train_batch_end/active.small_pool.current‚23298 \JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.allocated‚ 6579390419456 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.allocated‚67468357 MDDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.peak‚1009 HBDeviceStatsMonitor.on_train_batch_end/oversize_allocations.current‚0 N>DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 108454922 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚828614839017984 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚515 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚98669024 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚31200670 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 241355116 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚31201185 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚828614038488576 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚822035448598528 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 108454922 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚808065852377504 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 241355116 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 132900196 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚713321255235072 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚706194882590208 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 147645440 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _runtime‚6721.368355652 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 132923494 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚67468354 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚808065869416864 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 241378416 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 132900196 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 172549120 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚822035431559168 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚98669542 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 7126372644864 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6579390419456 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 241378416 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 108454920 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6557307950631 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6578606929408 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚814622378846043 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6578606929408 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 trainer/global_step‚5999 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 % _timestamp‚1.7884850692573457e+09 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚822035448598528 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696 PBDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.peak‚ 977437696 JDDeviceStatsMonitor.on_train_batch_end/oversize_allocations.allocated‚0 BDeviceStatsMonitor.on_train_batch_end/requested_bytes.all.peak‚ 22511104841 I@DeviceStatsMonitor.on_train_batch_end/segment.large_pool.current‚1309 SEDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.allocated‚ 108454922 I@DeviceStatsMonitor.on_train_batch_end/allocation.large_pool.peak‚3354 PDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.freed‚0 UGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.current‚ 998244352 WCDeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.allocated‚828614839017984 JBDeviceStatsMonitor.on_train_batch_end/segment.small_pool.allocated‚476 H@DeviceStatsMonitor.on_train_batch_end/segment.small_pool.current‚476 OGDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.current‚515 XJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.peak‚ 286040064 OADeviceStatsMonitor.on_train_batch_end/requested_bytes.all.current‚ 798521452 FDeviceStatsMonitor.on_train_batch_end/inactive_split.all.freed‚98669024 OADeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.current‚ 800529408 ICDeviceStatsMonitor.on_train_batch_end/allocation.large_pool.current‚2 REDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.freed‚31200670 RCDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.peak‚ 3109853696 ;5DeviceStatsMonitor.on_train_batch_end/num_device_free‚0 @:DeviceStatsMonitor.on_train_batch_end/num_sync_all_streams‚2 D6DeviceStatsMonitor.on_train_batch_end/active.all.freed‚ 241355116 ?6DeviceStatsMonitor.on_train_batch_end/num_device_alloc‚1785 GADeviceStatsMonitor.on_train_batch_end/oversize_segments.allocated‚0 SEDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.peak‚ 975420792 TDDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.peak‚ 24798822400 LDDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.peak‚750 VIDeviceStatsMonitor.on_train_batch_end/inactive_split.small_pool.allocated‚31201185 E?DeviceStatsMonitor.on_train_batch_end/oversize_segments.current‚0 S?DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.freed‚828614038488576 ^JDeviceStatsMonitor.on_train_batch_end/allocated_bytes.large_pool.allocated‚822035448598528 RBDeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.allocated‚ 25797066752 B9DeviceStatsMonitor.on_train_batch_end/segment.all.current‚1785 F=DeviceStatsMonitor.on_train_batch_end/segment.large_pool.peak‚1309 KEDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.freed‚0 OADeviceStatsMonitor.on_train_batch_end/active.large_pool.allocated‚ 108454922 YJDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.peak‚ 2911223808 ZFDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.freed‚808065852377504 UEDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.peak‚ 21653231616 L>DeviceStatsMonitor.on_train_batch_end/active_bytes.all.current‚ 800529408 H:DeviceStatsMonitor.on_train_batch_end/allocation.all.freed‚ 241355116 ;4DeviceStatsMonitor.on_train_batch_end/max_split_size‚-1 WGDeviceStatsMonitor.on_train_batch_end/reserved_bytes.large_pool.current‚ 24798822400 ?6DeviceStatsMonitor.on_train_batch_end/segment.all.peak‚1785 K=DeviceStatsMonitor.on_train_batch_end/active.small_pool.freed‚ 132900196 \HDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.allocated‚713321255235072 cODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.allocated‚706194882590208 [MDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.current‚ 147645440 D>DeviceStatsMonitor.on_train_batch_end/segment.large_pool.freed‚0 _runtime‚6721.368355652 C9DeviceStatsMonitor.on_train_batch_end/allocation.all.peak‚28433 MCDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.current‚23298 F=DeviceStatsMonitor.on_train_batch_end/inactive_split.all.peak‚1752 SEDeviceStatsMonitor.on_train_batch_end/allocation.small_pool.allocated‚ 132923494 REDeviceStatsMonitor.on_train_batch_end/inactive_split.large_pool.freed‚67468354 ^JDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.allocated‚808065869416864 M=DeviceStatsMonitor.on_train_batch_end/reserved_bytes.all.peak‚ 25797066752 H:DeviceStatsMonitor.on_train_batch_end/active.all.allocated‚ 241378416 B8DeviceStatsMonitor.on_train_batch_end/active.all.current‚23300 OADeviceStatsMonitor.on_train_batch_end/allocation.small_pool.freed‚ 132900196 TFDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.all.current‚ 172549120 =7DeviceStatsMonitor.on_train_batch_end/segment.all.freed‚0 K;DeviceStatsMonitor.on_train_batch_end/active_bytes.all.peak‚ 22941488640 WCDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.freed‚822035431559168 SEDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.current‚ 783490048 OBDeviceStatsMonitor.on_train_batch_end/inactive_split.all.allocated‚98669542 aODeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.small_pool.allocated‚ 7126372644864 YGDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.allocated‚ 6579390419456 N>DeviceStatsMonitor.on_train_batch_end/allocated_bytes.all.peak‚ 22941488640 L>DeviceStatsMonitor.on_train_batch_end/allocation.all.allocated‚ 241378416 UHDeviceStatsMonitor.on_train_batch_end/requested_bytes.large_pool.current‚17039360 K=DeviceStatsMonitor.on_train_batch_end/active.large_pool.freed‚ 108454920 EDeviceStatsMonitor.on_train_batch_end/segment.small_pool.freed‚0 ?5DeviceStatsMonitor.on_train_batch_end/active.all.peak‚28433 VHDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.current‚ 783490048 F@DeviceStatsMonitor.on_train_batch_end/oversize_allocations.freed‚0 \JDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.allocated‚ 6557307950631 KBDeviceStatsMonitor.on_train_batch_end/segment.large_pool.allocated‚1309 E?DeviceStatsMonitor.on_train_batch_end/active.large_pool.current‚2 XFDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.freed‚ 6578606929408 J@DeviceStatsMonitor.on_train_batch_end/allocation.small_pool.peak‚28166 S?DeviceStatsMonitor.on_train_batch_end/requested_bytes.all.freed‚814622378846043 WIDeviceStatsMonitor.on_train_batch_end/reserved_bytes.small_pool.allocated‚ 998244352 UCDeviceStatsMonitor.on_train_batch_end/active_bytes.small_pool.freed‚ 6578606929408 ZMDeviceStatsMonitor.on_train_batch_end/inactive_split_bytes.large_pool.current‚24903680 >8DeviceStatsMonitor.on_train_batch_end/num_oom_rejections‚0 VHDeviceStatsMonitor.on_train_batch_end/requested_bytes.small_pool.current‚ 781482092 E=DeviceStatsMonitor.on_train_batch_end/segment.small_pool.peak‚476 trainer/global_step‚5999 REDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.current‚17039360 D;DeviceStatsMonitor.on_train_batch_end/segment.all.allocated‚1785 % _timestamp‚1.7884850692573457e+09 [GDeviceStatsMonitor.on_train_batch_end/active_bytes.large_pool.allocated‚822035448598528 SEDeviceStatsMonitor.on_train_batch_end/allocated_bytes.small_pool.peak‚ 977437696ç¾Õþf2·- _wandbruntime‚6721  _runtime‚6721‰Aò^¸Ø % _timestamp‚1.7884850692609265e+09 _runtime‚6721.371272115 2loss/SRqqt1/assignment_loss‚0.9689417127199926 epoch‚9 2loss/SRqqt3/assignment_loss‚1.7000970834696836 1loss/SRqqt3/detection_loss‚2.5767491519451142 /loss/FBt1/detection_loss‚0.5843144952181589 /loss/FBt4/detection_loss‚2.2457469331807105 1loss/SRqqt2/assignment_loss‚1.085132672825081 2loss/SRqqt4/assignment_loss‚1.2011526247761288 1loss/FBt3/assignment_loss‚0.09645365647604026 1loss/FBt4/assignment_loss‚0.10262153640109443 1loss/SRqqt2/detection_loss‚1.1635096707788413 0loss/FRt1/assignment_loss‚1.2755034291342404 /loss/FRt4/assignment_loss‚3.178741598382909 /loss/FBt3/detection_loss‚2.4660162982486544 _step‚488 /loss/FRt2/detection_loss‚1.8558290572585285 1loss/SRqqt4/detection_loss‚2.3631950890431637 .loss/FBt2/detection_loss‚1.603727330143253 &loss/total_loss‚38.155504251478106 0loss/FRt2/assignment_loss‚1.9501318281835265 .loss/FRt3/detection_loss‚3.103890399499373 .loss/FRt4/detection_loss‚2.102824186864111 1loss/SRqqt1/detection_loss‚1.1586492239348305 trainer/global_step‚5999 1loss/FBt1/assignment_loss‚0.10094714027209215 1loss/FBt2/assignment_loss‚0.08577845546299272 .loss/FRt1/detection_loss‚1.725211149479231 0loss/FRt3/assignment_loss‚3.4603395277803592^®}‡c¹Ý .loss/FBt2/detection_loss‚1.603727330143253 &loss/total_loss‚38.155504251478106 0loss/FRt2/assignment_loss‚1.9501318281835265 .loss/FRt3/detection_loss‚3.103890399499373 .loss/FRt4/detection_loss‚2.102824186864111 1loss/SRqqt1/detection_loss‚1.1586492239348305 trainer/global_step‚5999 1loss/FBt1/assignment_loss‚0.10094714027209215 1loss/FBt2/assignment_loss‚0.08577845546299272 .loss/FRt1/detection_loss‚1.725211149479231 0loss/FRt3/assignment_loss‚3.4603395277803592 % _timestamp‚1.7884850692609265e+09 _runtime‚6721.371272115 2loss/SRqqt1/assignment_loss‚0.9689417127199926 epoch‚9 2loss/SRqqt3/assignment_loss‚1.7000970834696836 1loss/SRqqt3/detection_loss‚2.5767491519451142 /loss/FBt1/detection_loss‚0.5843144952181589 /loss/FBt4/detection_loss‚2.2457469331807105 1loss/SRqqt2/assignment_loss‚1.085132672825081 2loss/SRqqt4/assignment_loss‚1.2011526247761288 1loss/FBt3/assignment_loss‚0.09645365647604026 1loss/FBt4/assignment_loss‚0.10262153640109443 1loss/SRqqt2/detection_loss‚1.1635096707788413 0loss/FRt1/assignment_loss‚1.2755034291342404 /loss/FRt4/assignment_loss‚3.178741598382909 /loss/FBt3/detection_loss‚2.4660162982486544 _step‚488 /loss/FRt2/detection_loss‚1.8558290572585285 1loss/SRqqt4/detection_loss‚2.3631950890431637è…2ˆ]•º‚(:Š Ú»èÔ½ð׬ gpu.0.gpu‚78.0 gpu.0.memory‚19, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚38.0 gpu.0.powerWatts‚115.025' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.75625 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0 Ř³b»‚(:× Ú»èÔë•™® disk.rbd2.in‚0 disk.rbd0.in‚0 disk.rbd0.out‚ 1.8369140625 disk.rbd2.out‚ 1.8369140625 disk.sda.out‚ 780.18359375 disk.md0.out‚ 751.59375 disk.nvme1n1.in‚ 32.45703125 disk.sdb2.out‚ 780.18359375( disk./.usagePercent‚83.2372083730395$ disk./.usageGB‚2976.965751647949 disk.nvme0n1.in‚ 220.91015625 disk.dm-0.out‚ 81684.2578125 disk.sda.in‚ 57.7890625 disk.sda2.out‚ 780.18359375 disk.dm-0.in‚ 253.3671875# disk.nvme0n1.out‚42457.76171875 disk.sdb.out‚ 780.18359375* proc.memory.percent‚18.830537796020508 cpu‚25.754493369489836 proc.cpu.threads‚17 disk.md0p1.out‚ 751.59375 disk.sdb1.in‚0# disk.nvme1n1.out‚39226.49609375 disk.md0.in‚ 67.2421875$ memory_percent‚92.68178939819336' proc.memory.availableMB‚ 1199.015625 disk.sdb2.in‚9.453125 network.sent‚ 1.3216532e+07 network.recv‚ 2.151895e+06 disk.md0p1.in‚ 67.2421875 disk.sdb1.out‚0 disk.sda1.out‚0" proc.memory.rssMB‚ 3085.1953125 disk.sda1.in‚0 disk.sdb.in‚9.453125 disk.sda2.in‚ 57.7890625Ü[ו¼‚(:Š é»èÔ¹Çï© gpu.0.gpu‚60.0 gpu.0.memory‚10, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚42.0 gpu.0.powerWatts‚223.359' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚55.83975 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0g]Ïi½‚(:Þ é»èÔ·àÛª disk.sdb.out‚781.71630859375 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 753.08984375* proc.memory.percent‚18.830537796020508 proc.cpu.threads‚17 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.453125 disk.sdb2.in‚9.453125) disk./.usagePercent‚83.23908826491814 disk.sda.out‚781.71630859375! disk.sdb2.out‚781.71630859375 disk.rbd2.in‚0 cpu‚25.75403211619052 network.recv‚ 2.157699e+06! disk.nvme1n1.out‚ 39226.640625 disk.md0.out‚ 753.08984375 disk.rbd0.out‚ 1.8369140625 disk.dm-0.in‚ 253.3671875 disk.rbd2.out‚ 1.89990234375" memory_percent‚92.681884765625 network.sent‚ 1.3291226e+07 disk.sda1.out‚0" disk.nvme0n1.out‚ 42519.0234375 disk.sda2.in‚ 57.7890625 disk.dm-0.out‚ 81745.6640625 proc.memory.availableMB‚1199" proc.memory.rssMB‚ 3085.1953125 disk.sdb1.out‚0 disk.sda.in‚ 57.7890625 disk.md0p1.in‚ 67.2421875 disk.sda1.in‚0 disk.nvme0n1.in‚ 220.91015625 disk.rbd0.in‚0$ disk./.usageGB‚2977.032985687256 disk.sdb1.in‚0! disk.sda2.out‚781.71630859375±,U–’¾‚(:‡ ø»èÔêÅÿª gpu.0.gpu‚16.0 gpu.0.memory‚4, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚214.89' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚53.7225 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0SÝäa¿‚(:Ö ø»èÔ«Ы disk.dm-0.in‚ 253.3671875 network.recv‚ 2.1611e+06% disk./.usageGB‚2977.0339698791504 disk.nvme0n1.out‚ 42651.0625 disk.nvme1n1.in‚ 32.45703125 disk.sdb.in‚9.453125 disk.sdb2.in‚9.453125) disk./.usagePercent‚83.23911578333542 disk.sda2.in‚ 57.7890625 disk.nvme0n1.in‚ 220.91015625 disk.md0.out‚ 755.09375 disk.md0p1.in‚ 67.2421875" proc.memory.rssMB‚ 3085.1953125 disk.nvme1n1.out‚39226.75 disk.rbd0.in‚0* proc.memory.percent‚18.830537796020508 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sda1.out‚0 disk.sdb.out‚783.7880859375 disk.sda2.out‚783.7880859375 disk.dm-0.out‚ 81877.8125 disk.rbd2.in‚0 disk.rbd2.out‚ 1.89990234375 network.sent‚ 1.3298585e+07 disk.sdb1.in‚0 disk.sda.out‚783.7880859375 disk.sdb2.out‚783.7880859375$ memory_percent‚92.68043041229248) proc.memory.availableMB‚ 1199.23828125 cpu‚25.753501304153048 proc.cpu.threads‚17 disk.sda.in‚ 57.7890625 disk.md0.in‚ 67.2421875 disk.md0p1.out‚ 755.09375 disk.rbd0.out‚ 1.89990234375BC37”À‚(:‰ ‡¼èÔèú¢« gpu.0.gpu‚20.0 gpu.0.memory‚3, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚36.0 gpu.0.powerWatts‚114.131' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.53275 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0Þô§õmÁ‚(:â ‡¼èÔ–±à¬ disk.sda1.out‚0 disk.nvme0n1.out‚ 42849.71875! disk.nvme1n1.out‚ 39226.859375 disk.sda2.in‚ 57.7890625 disk.sdb1.in‚0 disk.sda.in‚ 57.7890625 disk.nvme1n1.in‚ 32.45703125 disk.rbd0.in‚0* proc.memory.percent‚18.835806846618652( proc.memory.availableMB‚ 1198.3203125 disk.sda.out‚785.29345703125 disk.md0p1.out‚ 756.546875 network.sent‚ 1.3304985e+07) disk./.usagePercent‚83.24261392880742 disk.dm-0.in‚ 253.3671875 disk.dm-0.out‚ 82076.578125 disk.rbd2.out‚ 1.962890625 disk.md0.in‚ 67.2421875$ memory_percent‚92.68603324890137 network.recv‚ 2.165717e+06 disk.sdb.in‚9.453125 disk.md0.out‚ 756.546875# proc.memory.rssMB‚ 3086.05859375 proc.cpu.threads‚17$ disk./.usageGB‚2977.159080505371 disk.nvme0n1.in‚ 220.91015625 disk.sdb.out‚785.29345703125 disk.sdb2.in‚9.453125! disk.sda2.out‚785.29345703125 disk.md0p1.in‚ 67.2421875 disk.rbd0.out‚ 1.89990234375 cpu‚25.764304343885684 disk.rbd2.in‚0 disk.sdb1.out‚0 disk.sda1.in‚0! disk.sdb2.out‚785.29345703125M´Mk’‚(:‡ –¼èÔñÔŽ« gpu.0.gpu‚1.0 gpu.0.memory‚0, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚36.0 gpu.0.powerWatts‚113.466' gpu.0.enforcedPowerLimitWatts‚400.0 gpu.0.powerPercent‚28.3665 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚03Jœ~`Â(:Õ –¼èÔž¡†° disk.sdb.in‚9.453125" proc.memory.rssMB‚ 3085.1953125 proc.cpu.threads‚17 disk.nvme1n1.in‚ 32.45703125 disk.nvme1n1.out‚ 39227.03125 disk.md0p1.out‚ 758.09375 disk.dm-0.in‚ 253.3671875 disk.dm-0.out‚ 82190.203125 disk.sda.in‚ 57.7890625 cpu‚25.77540888471149 disk.sdb.out‚ 786.900390625) disk./.usagePercent‚83.24610684791335 disk.sda2.out‚ 786.900390625 disk.rbd2.in‚0 disk.md0.in‚ 67.2421875 disk.rbd0.out‚ 1.962890625 disk.sda.out‚ 786.900390625$ disk./.usageGB‚2977.284004211426 disk.md0p1.in‚ 67.2421875! disk.nvme0n1.out‚ 42963.171875$ memory_percent‚92.68062114715576 disk.nvme0n1.in‚ 220.91015625 network.sent‚ 1.3310211e+07 disk.sda2.in‚ 57.7890625 disk.rbd0.in‚0 disk.sda1.in‚0 disk.sda1.out‚0 network.recv‚ 2.169155e+06 disk.rbd2.out‚ 1.962890625 disk.sdb1.in‚0 disk.sdb1.out‚0 disk.sdb2.out‚ 786.900390625* proc.memory.percent‚18.830537796020508 disk.md0.out‚ 758.09375 disk.sdb2.in‚9.453125) proc.memory.availableMB‚ 1199.207031255ÊætÄ‚(:’ ¥¼èÔší—« gpu.0.gpu‚38.0 gpu.0.memory‚6, gpu.0.memoryAllocated‚30.674819946289062* gpu.0.memoryAllocatedBytes‚ 26349469696 gpu.0.temp‚41.0 gpu.0.powerWatts‚241.577' gpu.0.enforcedPowerLimitWatts‚400.0( gpu.0.powerPercent‚60.39425000000001 gpu.0.smClock‚1410 gpu.0.memoryClock‚1593! gpu.0.correctedMemoryErrors‚0# gpu.0.uncorrectedMemoryErrors‚0FV+6uÅ‚(:ê ¥¼èÔЛî«) proc.memory.availableMB‚ 1198.41015625 disk.sdb2.in‚9.453125 disk.sda.out‚788.81396484375$ memory_percent‚92.68548488616943 cpu‚25.78630414569733 disk.rbd0.in‚0 disk.dm-0.in‚ 253.3671875# disk.nvme1n1.out‚39227.17578125 disk.sdb.out‚788.81396484375 proc.cpu.threads‚17) disk./.usagePercent‚83.24610684791335! disk.sdb2.out‚788.81396484375 disk.sdb1.out‚0 disk.sda1.in‚0 disk.sda1.out‚0 network.sent‚ 1.3314731e+07 disk.md0p1.in‚ 67.2421875 disk.md0p1.out‚ 759.94921875 disk.nvme1n1.in‚ 32.45703125 network.recv‚ 2.174126e+06 disk.sda2.in‚ 57.7890625 disk.dm-0.out‚ 82352.0390625 disk.rbd2.out‚ 1.962890625 disk.sdb.in‚9.453125$ disk./.usageGB‚2977.284004211426 disk.md0.in‚ 67.2421875# disk.nvme0n1.out‚43124.86328125* proc.memory.percent‚18.835806846618652! disk.sda2.out‚788.81396484375 disk.md0.out‚ 759.94921875 disk.rbd0.out‚ 1.962890625# proc.memory.rssMB‚ 3086.05859375 disk.rbd2.in‚0 disk.sdb1.in‚0 disk.sda.in‚ 57.7890625 disk.nvme0n1.in‚ 220.91015625Ñfî2Æ- _wandbruntime‚6810  _runtime‚6810„›M’o6Ç–© 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.7380952835083008 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5106716752052307 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.18622857332229614 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.04309696704149246 6 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.277937650680542 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.46666666865348816 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 9"Purity/1FRt*SRqqt2FBt/event_purity‚0.0821954682469368 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.22187818586826324 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9976283311843872 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9870370030403137 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0033122121822088957 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.21900708973407745 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 +jet/accuracy_3_of_6‚0.12280702590942383 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 particle/accuracy_5_of_7‚1 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 9"Purity/2FRt*SRqqt1FBt/event_purity‚0.0347873717546463 particle/accuracy_6_of_6‚1 jet/accuracy_6_of_7‚0 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9996017217636108 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.32247933745384216 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.21037037670612335 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 +jet/accuracy_4_of_6‚0.02631578966975212 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9872506856918335 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9854983687400818 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3017336428165436 ,"Purity/0FRt3SRqqt1FBt/event_purity‚0.125 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 8"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.539644181728363 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7412280440330505 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 particle/accuracy_1_of_7‚1 particle/accuracy_6_of_7‚1 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.23611114919185638 (particle/accuracy‚0.8493573665618896 jet/accuracy_5_of_7‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.40809592604637146 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11658094823360443 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2255040407180786 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22307731211185455 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.49358975887298584 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.19722223281860352 particle/accuracy_2_of_6‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9915515780448914 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6044217348098755 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.20000000298023224 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.12468495219945908 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 7 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.2111428678035736 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 ,particle/sensitivity‚0.33528053760528564 _runtime‚6810.789576298 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.7380952835083008 7 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.2767771780490875 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.023211775347590446 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9921841025352478 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5352205038070679 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017829131335020065 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04873674362897873 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.19251154363155365 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.027697117999196053 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.40485435724258423 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4546416699886322 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.20338580012321472 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 9"Purity/1FRt*SRqqt1FBt/event_purity‚0.1782359480857849 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6666666865348816 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23561827838420868 ;"Purity/2FRt0SRqqt1FBt/event_purity‚0.059947095811367035 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 +"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚0.25 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9177778363227844 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4484948217868805 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 particle/accuracy_1_of_6‚1 jet/accuracy_4_of_7‚0 8"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.528753399848938 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.3941928744316101 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.4947195053100586 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 7 Purity/1FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.33560606837272644 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 & Purity/1FRt0SRqqt4FBt/FRt_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 particle/accuracy_7_of_7‚1 + Purity/0FRt3SRqqt*FBt/FBt_purity‚0.9375 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3369482755661011 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 )loss/val_total_loss‚37.49732104489475 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.3857136368751526 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.07183908671140671 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.44517838954925537 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.20077352225780487 :"Purity/*FRt3SRqqt1FBt/event_purity‚0.02380952425301075 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.22549018263816833 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.3885573446750641 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.25641027092933655 particle/accuracy_3_of_4‚1 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.42272451519966125 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.3771243691444397 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6785714030265808 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.48471587896347046 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 & Purity/*FRt0SRqqt4FBt/FRt_purity‚0 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.3757650852203369 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 +jet/accuracy_2_of_5‚0.47223174571990967 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.42110684514045715 <"Purity/2FRt1SRqqt0FBt/event_purity‚0.0037220846861600876 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5703675746917725 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5280555486679077 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 *jet/accuracy_1_of_3‚0.8453668355941772 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ( Purity/4FRt1SRqqt*FBt/FRt_purity‚0.5 _step‚489 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 particle/accuracy_2_of_4‚1 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3333333730697632 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 particle/accuracy_2_of_3‚1 particle/accuracy_4_of_7‚1 :"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.42833542823791504 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.2731182873249054 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 ,jet/accuracy_3_of_3‚0.027600741013884544 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1130952388048172 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 particle/accuracy_5_of_6‚1 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5378572940826416 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.4451787769794464 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 9"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.3363473415374756 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 & Purity/*FRt*SRqqt4FBt/FRt_purity‚0 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.15625 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.38692018389701843 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.41655072569847107 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.36810335516929626 9"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.4281178116798401 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.2888889014720917 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,jet/accuracy_4_of_5‚0.007857734337449074 particle/accuracy_4_of_6‚1 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 + Purity/0FRt3SRqqt1FBt/FBt_purity‚0.9375 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 ( Purity/4FRt1SRqqt0FBt/FRt_purity‚0.5 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.19130533933639526 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3463174104690552 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 trainer/global_step‚6039 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.29572799801826477 part §.^icle/accuracy_2_of_5‚1 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.42513155937194824 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.001792114693671465 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.46710526943206787 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6764705777168274 6 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.380952388048172 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4227466285228729 jet/accuracy_1_of_7‚1 7 Purity/1FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 8"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.694444477558136 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.010008271783590317 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.06714896857738495 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 particle/accuracy_3_of_5‚1 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9900233149528503 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.26448872685432434 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.3771243691444397 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.21419590711593628 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3088477849960327 :"Purity/0FRt*SRqqt0FBt/event_purity‚0.29964783787727356 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.21296299993991852 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.15789255499839783 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.3782143294811249 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5532367825508118 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.20000000298023224 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 <"Purity/2FRt*SRqqt0FBt/event_purity‚0.0051079923287034035 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9918815493583679 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 particle/accuracy_1_of_2‚1 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9877082109451294 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.21147185564041138 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.30000001192092896 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.012445571832358837 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.35042884945869446 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.23105545341968536 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.024226782843470573 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.19589094817638397 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 jet/accuracy_3_of_7‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.032155659049749374 8 Purity/*FRt2SRqqt0FBt/FRt_purity‚0.21079763770103455 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.3680083453655243 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9479166865348816 7 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.3088723123073578 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.26428574323654175 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9979733228683472 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4611110985279083 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4945652186870575 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 jet/accuracy_7_of_7‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9885495901107788 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9939948916435242 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4034864008426666 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2461981624364853 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.40812966227531433 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 7 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.2334199994802475 9"Purity/1FRt*SRqqt0FBt/event_purity‚0.0990230143070221 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 6 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.920634925365448 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.23429954051971436 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9868628978729248 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9966678023338318 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5672703385353088 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 jet/accuracy_5_of_5‚0 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.24889153242111206 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 8"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.598601758480072 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 7validation_average_jet_accuracy‚0.40971502661705017 *jet/accuracy_2_of_6‚0.6052631735801697 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.06541219353675842 :"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.43466466665267944 (particle/f_score‚0.41003817319869995 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.4456685185432434 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3562609851360321 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 particle/accuracy_5_of_5‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.18993358314037323 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22832661867141724 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3958333432674408 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.04320988059043884 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9851189851760864 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.41087645292282104 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9176245927810669 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4030792713165283 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5815570950508118 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9942372441291809 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 +jet/accuracy_3_of_5‚0.09723260998725891 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2489883452653885 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.3125 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979884624481201 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.05000000074505806 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9981114864349365 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_5‚0.9511753916740417 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5358825922012329 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.26330676674842834 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6056687235832214 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 *jet/accuracy_1_of_1‚0.4374450743198395 particle/accuracy_3_of_7‚1 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.040771473199129105 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 ) Purity/4FRt*SRqqt0FBt/FRt_purity‚0.25 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.30496135354042053 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9900479912757874 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7061403393745422 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt1SRqqt*FBt/event_purity‚0.1757984608411789 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5671088695526123 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.01822051778435707 :"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.38525477051734924 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.23757478594779968 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.05000000074505806 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.34816014766693115 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5260416865348816 +particle/specificity‚0.9445048570632935 & Purity/1FRt*SRqqt4FBt/FRt_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6523815989494324 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4685317277908325 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_5‚1 ;"Purity/0FRt3SRqqt*FBt/event_purity‚0.003968254197388887 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 7 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.3748592436313629 ;"Purity/2FRt1SRqqt*FBt/event_purity‚0.004274473991245031 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03787878900766373 jet/accuracy_6_of_6‚0 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3769434988498688 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.014285714365541935 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1785714328289032 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.2222222238779068 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 7"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.39682537317276 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 +jet/accuracy_2_of_2‚0.11173839867115021 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.017777778208255768 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2850809395313263 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.056111108511686325 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.31550338864326477 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 /"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.265625 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 + Purity/1FRt*SRqqt3FBt/FRt_purity‚0.6875 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6129416823387146 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9872635006904602 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.12027335911989212 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3900153338909149 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4660494029521942 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 *jet/accuracy_2_of_4‚0.3542517423629761 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ;"Purity/3FRt*SRqqt*FBt/event_purity‚0.008192525245249271 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.2222222238779068 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.18759259581565857 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.017474550753831863 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.49561405181884766 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2607961595058441 *jet/accuracy_2_of_3‚0.2415509670972824 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 8"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.523809552192688 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 7 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.2984892725944519 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.009291778318583965 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.18464043736457825 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.19496546685695648 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7204058766365051 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 particle/accuracy_4_of_4‚1 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2347685694694519 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5529438853263855 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5409764051437378 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.4305555820465088 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.40232181549072266 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.33273813128471375 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.11999999731779099 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 epoch‚9 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2757412791252136 7"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.62797611951828 *jet/accuracy_1_of_4‚0.9055361151695251 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.3749999701976776 particle/accuracy_1_of_4‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 $ _timestamp‚1.788485158677078e+09 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4089757204055786 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 jet/accuracy_5_of_6‚0 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.4615384638309479 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 7 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.2944444417953491 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ;"Purity/3FRt*SRqqt1FBt/event_purity‚0.024242425337433815 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_1‚1 particle/accuracy_4_of_5‚1 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.24358974397182465 6 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.897119402885437 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.42251327633857727 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.32062214612960815 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 particle/accuracy_3_of_6‚1 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9871938228607178 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9691274762153625 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5595238208770752 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5654249787330627 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.24410425126552582 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9236111640930176 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.41642460227012634 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.02500000037252903 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8119551539421082 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ) Purity/4FRt*SRqqt*FBt/FRt_purity‚0.25 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 *jet/accuracy_1_of_6‚0.9210526347160339 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.26919135451316833 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2222222238779068 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7038219571113586 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 8"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.433145135641098 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 8"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.523809552192688 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9923309087753296 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 jet/accuracy_2_of_7‚0.5 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9930368065834045 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.21900708973407745 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_7‚1Œ vÄ!È›© ("Purity/2FRt2SRqqt2FBt/SRqqt_purity‚0 :"Purity/*FRt*SRqqt*FBt/SRqqt_purity‚0.42272451519966125 9"Purity/0FRt1SRqqt0FBt/SRqqt_purity‚0.3771243691444397 ?&Purity/1FRt0SRqqt2FBt/event_proportion‚0.015120967291295528 7 Purity/1FRt0SRqqt3FBt/FRt_purity‚0.6785714030265808 :"Purity/1FRt2SRqqt1FBt/SRqqt_purity‚0.48471587896347046 ,&Purity/3FRt2SRqqt4FBt/event_proportion‚0 9"Purity/0FRt4SRqqt0FBt/SRqqt_purity‚0.2857142984867096 & Purity/*FRt0SRqqt4FBt/FRt_purity‚0 9"Purity/0FRt*SRqqt0FBt/SRqqt_purity‚0.3757650852203369 ?&Purity/1FRt0SRqqt1FBt/event_proportion‚0.049773186445236206 ?&Purity/2FRt*SRqqt1FBt/event_proportion‚0.021169355139136314 +jet/accuracy_2_of_5‚0.47223174571990967 & Purity/2FRt2SRqqt2FBt/FBt_purity‚1 :"Purity/0FRt*SRqqt*FBt/event_purity‚0.42110684514045715 <"Purity/2FRt1SRqqt0FBt/event_purity‚0.0037220846861600876 & Purity/0FRt2SRqqt2FBt/FBt_purity‚1 ("Purity/2FRt2SRqqt2FBt/event_purity‚0 ("Purity/4FRt2SRqqt*FBt/event_purity‚0 9"Purity/*FRt1SRqqt1FBt/SRqqt_purity‚0.5703675746917725 7 Purity/2FRt*SRqqt2FBt/FRt_purity‚0.5280555486679077 ?&Purity/2FRt0SRqqt0FBt/event_proportion‚0.024571573361754417 ?&Purity/2FRt0SRqqt1FBt/event_proportion‚0.008946572430431843 ,&Purity/4FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt4SRqqt1FBt/event_proportion‚0 *jet/accuracy_1_of_3‚0.8453668355941772 ("Purity/4FRt2SRqqt0FBt/SRqqt_purity‚1 ,&Purity/3FRt*SRqqt3FBt/event_proportion‚0 ( Purity/4FRt1SRqqt*FBt/FRt_purity‚0.5 _step‚489 >&Purity/*FRt0SRqqt1FBt/event_proportion‚0.14591734111309052 =&Purity/*FRt1SRqqt1FBt/event_proportion‚0.1001134067773819 @&Purity/0FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ;"Purity/2FRt1SRqqt1FBt/event_purity‚0.008064515888690948 particle/accuracy_2_of_4‚1 >&Purity/*FRt*SRqqt2FBt/event_proportion‚0.06747731566429138 >&Purity/0FRt0SRqqt1FBt/event_proportion‚0.08606351166963577 7 Purity/3FRt0SRqqt*FBt/FRt_purity‚0.3333333730697632 ,&Purity/4FRt1SRqqt2FBt/event_proportion‚0 particle/accuracy_2_of_3‚1 particle/accuracy_4_of_7‚1 :"Purity/*FRt1SRqqt*FBt/SRqqt_purity‚0.42833542823791504 ,&Purity/0FRt4SRqqt2FBt/event_proportion‚0 7 Purity/1FRt2SRqqt1FBt/FRt_purity‚0.2731182873249054 @&Purity/1FRt4SRqqt0FBt/event_proportion‚0.0003780241822823882 @&Purity/3FRt3SRqqt0FBt/event_proportion‚0.0005670362734235823 ,jet/accuracy_3_of_3‚0.027600741013884544 & Purity/0FRt4SRqqt1FBt/FBt_purity‚1 7 Purity/3FRt4SRqqt*FBt/FRt_purity‚0.3333333432674408 ,&Purity/2FRt4SRqqt3FBt/event_proportion‚0 9"Purity/3FRt1SRqqt1FBt/SRqqt_purity‚0.6538461446762085 9"Purity/*FRt0SRqqt3FBt/event_purity‚0.1130952388048172 7 Purity/0FRt2SRqqt1FBt/FBt_purity‚0.9838709831237793 particle/accuracy_5_of_6‚1 9"Purity/0FRt1SRqqt1FBt/SRqqt_purity‚0.5378572940826416 9"Purity/2FRt2SRqqt0FBt/SRqqt_purity‚0.4451787769794464 @&Purity/3FRt0SRqqt*FBt/event_proportion‚0.0027091733645647764 ,&Purity/4FRt0SRqqt4FBt/event_proportion‚0 9"Purity/0FRt3SRqqt*FBt/SRqqt_purity‚0.3363473415374756 8 Purity/2FRt3SRqqt1FBt/FRt_purity‚0.30000001192092896 & Purity/*FRt*SRqqt4FBt/FRt_purity‚0 +"Purity/1FRt1SRqqt3FBt/SRqqt_purity‚0.75 @&Purity/*FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 =&Purity/1FRt*SRqqt0FBt/event_proportion‚0.3135710656642914 ."Purity/1FRt*SRqqt3FBt/event_purity‚0.15625 :"Purity/1FRt1SRqqt0FBt/SRqqt_purity‚0.38692018389701843 @&Purity/2FRt0SRqqt3FBt/event_proportion‚6.300403038039804e-05 :"Purity/2FRt1SRqqt*FBt/SRqqt_purity‚0.41655072569847107 & Purity/2FRt2SRqqt1FBt/FBt_purity‚1 ,&Purity/2FRt3SRqqt4FBt/event_proportion‚0 8 Purity/*FRt*SRqqt1FBt/FRt_purity‚0.36810335516929626 9"Purity/*FRt2SRqqt*FBt/SRqqt_purity‚0.4281178116798401 7 Purity/1FRt3SRqqt1FBt/FRt_purity‚0.2888889014720917 & Purity/3FRt0SRqqt*FBt/FBt_purity‚1 ?&Purity/3FRt1SRqqt*FBt/event_proportion‚0.003717237850651145 ,&Purity/3FRt3SRqqt3FBt/event_proportion‚0 @&Purity/4FRt1SRqqt*FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt4SRqqt0FBt/event_proportion‚0 @&Purity/0FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ("Purity/3FRt2SRqqt*FBt/event_purity‚0 ,jet/accuracy_4_of_5‚0.007857734337449074 particle/accuracy_4_of_6‚1 ("Purity/3FRt4SRqqt*FBt/event_purity‚0 + Purity/0FRt3SRqqt1FBt/FBt_purity‚0.9375 ( Purity/2FRt0SRqqt3FBt/FRt_purity‚0.5 ( Purity/4FRt1SRqqt0FBt/FRt_purity‚0.5 8 Purity/2FRt2SRqqt0FBt/FRt_purity‚0.19130533933639526 9"Purity/2FRt3SRqqt*FBt/SRqqt_purity‚0.3463174104690552 +"Purity/3FRt1SRqqt2FBt/SRqqt_purity‚0.75 trainer/global_step‚6039 8 Purity/*FRt2SRqqt1FBt/FRt_purity‚0.29572799801826477 particle/accuracy_2_of_5‚1 :"Purity/*FRt*SRqqt1FBt/event_purity‚0.42513155937194824 ;"Purity/*FRt3SRqqt*FBt/event_purity‚0.001792114693671465 8 Purity/2FRt1SRqqt2FBt/FRt_purity‚0.46710526943206787 & Purity/3FRt0SRqqt2FBt/FBt_purity‚1 & Purity/2FRt*SRqqt3FBt/FBt_purity‚1 7 Purity/*FRt*SRqqt3FBt/FRt_purity‚0.6764705777168274 6 Purity/2FRt0SRqqt1FBt/FRt_purity‚0.380952388048172 9"Purity/3FRt*SRqqt0FBt/SRqqt_purity‚0.4227466285228729 jet/accuracy_1_of_7‚1 7 Purity/1FRt4SRqqt*FBt/FRt_purity‚0.1666666716337204 @&Purity/1FRt*SRqqt3FBt/event_proportion‚0.0013230846961960196 8"Purity/3FRt*SRqqt1FBt/SRqqt_purity‚0.694444477558136 A&Purity/3FRt1SRqqt2FBt/event_proportion‚0.00025201612152159214 >&Purity/*FRt0SRqqt0FBt/event_proportion‚0.15757308900356293 ,&Purity/2FRt*SRqqt4FBt/event_proportion‚0 ;"Purity/2FRt0SRqqt0FBt/event_purity‚0.010008271783590317 ("Purity/2FRt2SRqqt1FBt/event_purity‚0 ,&Purity/4FRt0SRqqt2FBt/event_proportion‚0 +jet/accuracy_3_of_4‚0.06714896857738495 ("Purity/*FRt4SRqqt*FBt/event_purity‚0 7 Purity/3FRt2SRqqt1FBt/FRt_purity‚0.2777777910232544 particle/accuracy_3_of_5‚1 ("Purity/3FRt1SRqqt2FBt/event_purity‚0 7 Purity/0FRt*SRqqt*FBt/FBt_purity‚0.9900233149528503 :"Purity/0FRt*SRqqt2FBt/event_purity‚0.26448872685432434 9"Purity/0FRt1SRqqt0FBt/event_purity‚0.3771243691444397 8 Purity/1FRt2SRqqt0FBt/FRt_purity‚0.21419590711593628 & Purity/2FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt2FBt/event_proportion‚0 particle/accuracy_1_of_3‚1 ("Purity/0FRt4SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt*FBt/FRt_purity‚0.3088477849960327 :"Purity/0FRt*SRqqt0FBt/event_purity‚0.29964783787727356 ?&Purity/2FRt2SRqqt1FBt/event_proportion‚0.003969253972172737 8 Purity/3FRt1SRqqt*FBt/FRt_purity‚0.21296299993991852 @&Purity/3FRt2SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/4FRt*SRqqt3FBt/event_proportion‚0 :"Purity/*FRt*SRqqt0FBt/event_purity‚0.15789255499839783 9"Purity/*FRt1SRqqt0FBt/SRqqt_purity‚0.3782143294811249 9"Purity/*FRt1SRqqt2FBt/SRqqt_purity‚0.5532367825508118 8 Purity/2FRt4SRqqt0FBt/FRt_purity‚0.20000000298023224 & Purity/3FRt2SRqqt1FBt/FBt_purity‚1 ("Purity/1FRt1SRqqt3FBt/event_purity‚0 ?&Purity/0FRt2SRqqt0FBt/event_proportion‚0.043283771723508835 7 Purity/1FRt0SRqqt2FBt/FBt_purity‚0.9874216318130493 <"Purity/2FRt*SRqqt0FBt/event_purity‚0.0051079923287034035 ,&Purity/3FRt3SRqqt4FBt/event_proportion‚0 +"Purity/3FRt4SRqqt0FBt/SRqqt_purity‚0.25 +"Purity/1FRt*SRqqt3FBt/SRqqt_purity‚0.75 7 Purity/*FRt0SRqqt*FBt/FBt_purity‚0.9918815493583679 ?&Purity/1FRt3SRqqt0FBt/event_proportion‚0.007938507944345474 @&Purity/2FRt4SRqqt*FBt/event_proportion‚0.0003150201519019902 & Purity/3FRt1SRqqt*FBt/FBt_purity‚1 ,&Purity/3FRt3SRqqt1FBt/event_proportion‚0 particle/accuracy_1_of_2‚1 7 Purity/*FRt2SRqqt1FBt/FBt_purity‚0.9877082109451294 ("Purity/1FRt3SRqqt*FBt/event_purity‚0 8 Purity/2FRt3SRqqt0FBt/FRt_purity‚0.21147185564041138 ,&Purity/3FRt0SRqqt3FBt/event_proportion‚0 @&Purity/3FRt1SRqqt1FBt/event_proportion‚0.0009450604557059705 :"Purity/2FRt3SRqqt1FBt/SRqqt_purity‚0.30000001192092896 >&Purity/*FRt*SRqqt1FBt/event_proportion‚0.27079132199287415 ;"Purity/2FRt*SRqqt*FBt/event_purity‚0.012445571832358837 :"Purity/2FRt1SRqqt0FBt/SRqqt_purity‚0.35042884945869446 ,&Purity/2FRt1SRqqt4FBt/event_proportion‚0 & Purity/3FRt*SRqqt2FBt/FBt_purity‚1 8 Purity/*FRt*SRqqt0FBt/FRt_purity‚0.23105545341968536 ;"Purity/1FRt1SRqqt*FBt/event_purity‚0.024226782843470573 8 Purity/1FRt3SRqqt0FBt/FRt_purity‚0.19589094817638397 ,&Purity/1FRt3SRqqt4FBt/event_proportion‚0 ,&Purity/1FRt4SRqqt1FBt/event_proportion‚0 jet/accuracy_3_of_7‚0 & Purity/*FRt3SRqqt2FBt/FRt_purity‚0 ;"Purity/*FRt1SRqqt2FBt/event_purity‚0.032155659049749374 8åÄ—ÐÞr Purity/*FRt2SRqqt0FBt/FRt_purity‚0.21079763770103455 9"Purity/*FRt3SRqqt0FBt/SRqqt_purity‚0.3680083453655243 ,&Purity/4FRt*SRqqt1FBt/event_proportion‚0 ("Purity/*FRt4SRqqt0FBt/event_purity‚0 ("Purity/0FRt4SRqqt*FBt/event_purity‚0 ("Purity/2FRt4SRqqt*FBt/event_purity‚0 & Purity/2FRt3SRqqt1FBt/FBt_purity‚1 @&Purity/0FRt4SRqqt*FBt/event_proportion‚0.0005040322430431843 7 Purity/1FRt*SRqqt3FBt/FBt_purity‚0.9479166865348816 7 Purity/1FRt0SRqqt*FBt/FRt_purity‚0.3088723123073578 8 Purity/2FRt2SRqqt1FBt/FRt_purity‚0.26428574323654175 & Purity/3FRt*SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt2FBt/event_proportion‚0.0003150201519019902 @&Purity/4FRt2SRqqt0FBt/event_proportion‚6.300403038039804e-05 * Purity/1FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/*FRt*SRqqt1FBt/FBt_purity‚0.9979733228683472 9"Purity/0FRt*SRqqt2FBt/SRqqt_purity‚0.4611110985279083 & Purity/1FRt3SRqqt1FBt/FBt_purity‚1 9"Purity/3FRt2SRqqt0FBt/SRqqt_purity‚0.4945652186870575 ,&Purity/4FRt3SRqqt*FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt0FBt/event_proportion‚0 jet/accuracy_7_of_7‚0 ("Purity/4FRt2SRqqt0FBt/event_purity‚0 7 Purity/*FRt0SRqqt2FBt/FBt_purity‚0.9885495901107788 >&Purity/1FRt2SRqqt0FBt/event_proportion‚0.04731602966785431 & Purity/3FRt1SRqqt2FBt/FBt_purity‚1 ,&Purity/0FRt3SRqqt3FBt/event_proportion‚0 7 Purity/1FRt0SRqqt*FBt/FBt_purity‚0.9939948916435242 7 Purity/1FRt1SRqqt2FBt/FRt_purity‚0.4034864008426666 ("Purity/1FRt3SRqqt1FBt/event_purity‚0 7 Purity/3FRt*SRqqt*FBt/FRt_purity‚0.2461981624364853 ,&Purity/3FRt4SRqqt4FBt/event_proportion‚0 >&Purity/0FRt2SRqqt*FBt/event_proportion‚0.05361643061041832 :"Purity/0FRt2SRqqt*FBt/SRqqt_purity‚0.40812966227531433 6 Purity/1FRt2SRqqt1FBt/FBt_purity‚0.980875551700592 7 Purity/2FRt0SRqqt0FBt/FRt_purity‚0.2334199994802475 9"Purity/1FRt*SRqqt0FBt/event_purity‚0.0990230143070221 ?&Purity/1FRt1SRqqt2FBt/event_proportion‚0.006111391354352236 ,&Purity/4FRt1SRqqt3FBt/event_proportion‚0 particle/accuracy_3_of_3‚1 6 Purity/*FRt1SRqqt3FBt/FBt_purity‚0.920634925365448 8 Purity/3FRt2SRqqt0FBt/FRt_purity‚0.23429954051971436 A&Purity/0FRt4SRqqt0FBt/event_proportion‚0.00044102821266278625 >&Purity/*FRt3SRqqt0FBt/event_proportion‚0.01827116869390011 7 Purity/0FRt*SRqqt2FBt/FBt_purity‚0.9868628978729248 7 Purity/0FRt1SRqqt1FBt/FBt_purity‚0.9966678023338318 ) Purity/*FRt1SRqqt4FBt/FBt_purity‚0.75 & Purity/4FRt2SRqqt*FBt/FRt_purity‚0 @&Purity/*FRt*SRqqt4FBt/event_proportion‚0.0003780241822823882 7 Purity/*FRt0SRqqt2FBt/FRt_purity‚0.5672703385353088 >&Purity/0FRt*SRqqt*FBt/event_proportion‚0.40996724367141724 @&Purity/1FRt2SRqqt2FBt/event_proportion‚0.0010080644860863686 ?&Purity/2FRt*SRqqt2FBt/event_proportion‚0.005418346729129553 jet/accuracy_5_of_5‚0 *"Purity/0FRt4SRqqt1FBt/SRqqt_purity‚0.5 7 Purity/3FRt1SRqqt2FBt/FRt_purity‚0.3333333432674408 8 Purity/*FRt1SRqqt0FBt/FRt_purity‚0.24889153242111206 ?&Purity/*FRt2SRqqt2FBt/event_proportion‚0.002079133177176118 8"Purity/2FRt*SRqqt1FBt/SRqqt_purity‚0.598601758480072 @&Purity/2FRt4SRqqt0FBt/event_proportion‚0.0003150201519019902 ("Purity/1FRt0SRqqt4FBt/event_purity‚0 =&Purity/*FRt*SRqqt*FBt/event_proportion‚0.9591733813285828 @&Purity/3FRt*SRqqt1FBt/event_proportion‚0.0024571572430431843 7validation_average_jet_accuracy‚0.40971502661705017 *jet/accuracy_2_of_6‚0.6052631735801697 & Purity/2FRt0SRqqt3FBt/FBt_purity‚1 ("Purity/4FRt*SRqqt0FBt/event_purity‚0 =&Purity/*FRt*SRqqt0FBt/event_proportion‚0.6160534024238586 7 Purity/*FRt3SRqqt*FBt/FBt_purity‚0.9772727489471436 @&Purity/*FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 @&Purity/1FRt0SRqqt4FBt/event_proportion‚6.300403038039804e-05 ("Purity/1FRt2SRqqt0FBt/event_purity‚0 @&Purity/4FRt*SRqqt0FBt/event_proportion‚0.0001890120911411941 ("Purity/0FRt3SRqqt0FBt/event_purity‚0 9"Purity/*FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 @&Purity/*FRt4SRqqt0FBt/event_proportion‚0.0012600806076079607 :"Purity/0FRt2SRqqt1FBt/event_purity‚0.06541219353675842 :"Purity/2FRt*SRqqt*FBt/SRqqt_purity‚0.43466466665267944 (particle/f_score‚0.41003817319869995 9"Purity/1FRt1SRqqt*FBt/SRqqt_purity‚0.4456685185432434 7 Purity/2FRt*SRqqt1FBt/FRt_purity‚0.3562609851360321 @&Purity/3FRt2SRqqt0FBt/event_proportion‚0.0024571572430431843 particle/accuracy_5_of_5‚1 8 Purity/*FRt3SRqqt*FBt/FRt_purity‚0.18993358314037323 ?&Purity/*FRt3SRqqt1FBt/event_proportion‚0.002142137149348855 ,&Purity/*FRt3SRqqt3FBt/event_proportion‚0 8 Purity/1FRt*SRqqt0FBt/FRt_purity‚0.22832661867141724 ,&Purity/2FRt0SRqqt4FBt/event_proportion‚0 @&Purity/3FRt0SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt2SRqqt1FBt/SRqqt_purity‚0.6666666865348816 9"Purity/0FRt3SRqqt1FBt/SRqqt_purity‚0.3958333432674408 :"Purity/0FRt*SRqqt3FBt/event_purity‚0.04320988059043884 ,&Purity/0FRt2SRqqt4FBt/event_proportion‚0 7 Purity/1FRt1SRqqt2FBt/FBt_purity‚0.9851189851760864 :"Purity/1FRt3SRqqt*FBt/SRqqt_purity‚0.41087645292282104 ("Purity/3FRt1SRqqt0FBt/event_purity‚0 @&Purity/4FRt*SRqqt*FBt/event_proportion‚0.0001890120911411941 ,&Purity/4FRt*SRqqt2FBt/event_proportion‚0 @&Purity/4FRt0SRqqt*FBt/event_proportion‚6.300403038039804e-05 7 Purity/*FRt*SRqqt3FBt/FBt_purity‚0.9176245927810669 >&Purity/*FRt1SRqqt0FBt/event_proportion‚0.33039313554763794 9"Purity/*FRt2SRqqt0FBt/SRqqt_purity‚0.4030792713165283 7 Purity/1FRt0SRqqt2FBt/FRt_purity‚0.5815570950508118 7 Purity/1FRt1SRqqt*FBt/FBt_purity‚0.9942372441291809 ,&Purity/1FRt2SRqqt4FBt/event_proportion‚0 @&Purity/1FRt3SRqqt1FBt/event_proportion‚0.0011340725468471646 7 Purity/*FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 ,&Purity/1FRt4SRqqt3FBt/event_proportion‚0 >&Purity/2FRt*SRqqt0FBt/event_proportion‚0.07579384744167328 A&Purity/3FRt4SRqqt0FBt/event_proportion‚0.00012600806076079607 +jet/accuracy_3_of_5‚0.09723260998725891 * Purity/*FRt*SRqqt4FBt/FBt_purity‚0.875 ("Purity/*FRt3SRqqt2FBt/event_purity‚0 9"Purity/*FRt0SRqqt2FBt/event_purity‚0.2489883452653885 ,&Purity/*FRt4SRqqt3FBt/event_proportion‚0 ,&Purity/0FRt1SRqqt4FBt/event_proportion‚0 >&Purity/1FRt2SRqqt*FBt/event_proportion‚0.05727066472172737 ("Purity/1FRt3SRqqt0FBt/event_purity‚0 ,&Purity/4FRt1SRqqt1FBt/event_proportion‚0 *"Purity/*FRt4SRqqt1FBt/SRqqt_purity‚0.5 -"Purity/0FRt4SRqqt*FBt/SRqqt_purity‚0.3125 7 Purity/1FRt*SRqqt1FBt/FBt_purity‚0.9979884624481201 @&Purity/2FRt3SRqqt1FBt/event_proportion‚0.0003780241822823882 ,&Purity/4FRt2SRqqt2FBt/event_proportion‚0 :"Purity/2FRt4SRqqt*FBt/SRqqt_purity‚0.05000000074505806 7 Purity/*FRt1SRqqt1FBt/FBt_purity‚0.9981114864349365 ,&Purity/3FRt0SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_5‚0.9511753916740417 & Purity/*FRt3SRqqt2FBt/FBt_purity‚1 9"Purity/*FRt2SRqqt1FBt/SRqqt_purity‚0.5358825922012329 ?&Purity/*FRt3SRqqt*FBt/event_proportion‚0.020476309582591057 8 Purity/1FRt1SRqqt*FBt/FRt_purity‚0.26330676674842834 9"Purity/1FRt1SRqqt1FBt/SRqqt_purity‚0.6056687235832214 ,&Purity/4FRt3SRqqt1FBt/event_proportion‚0 *jet/accuracy_1_of_1‚0.4374450743198395 particle/accuracy_3_of_7‚1 7 Purity/3FRt*SRqqt2FBt/FRt_purity‚0.4000000059604645 @&Purity/0FRt*SRqqt3FBt/event_proportion‚0.0030871976632624865 ?&Purity/2FRt0SRqqt2FBt/event_proportion‚0.003465221729129553 ,"Purity/1FRt4SRqqt0FBt/SRqqt_purity‚0.375 7 Purity/0FRt1SRqqt3FBt/FBt_purity‚0.8666666150093079 ;"Purity/0FRt2SRqqt*FBt/event_purity‚0.040771473199129105 ( Purity/2FRt*SRqqt3FBt/FRt_purity‚0.5 ) Purity/4FRt*SRqqt0FBt/FRt_purity‚0.25 ?&Purity/*FRt*SRqqt3FBt/event_proportion‚0.004473286215215921 =&Purity/*FRt1SRqqt*FBt/event_proportion‚0.4482736885547638 8 Purity/*FRt1SRqqt1FBt/FRt_purity‚0.30496135354042053 >&Purity/*FRt2SRqqt0FBt/event_proportion‚0.10855595022439957 ?&Purity/2FRt1SRqqt1FBt/event_proportion‚0.007875503972172737 ,&Purity/4FRt4SRqqt4FBt/event_proportion‚0 ("Purity/3FRt3SRqqt0FBt/event_purity‚0 7 Purity/0FRt0SRqqt*FBt/FBt_purity‚0.9900479912757874 ?&Purity/0FRt2SRqqt1FBt/event_proportion‚0.009261592291295528 9"Purity/2FRt*SRqqt2FBt/SRqqt_purity‚0.7061403393745422 7 Purity/2FRt1SRqqt2FBt/FBt_purity‚0.9868420958518982 ,&Purity/2FRt2SRqqt3FBt/event_proportion‚0 ,&Purity/2FRt3SRqqt3FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt3FBt/event_proportion‚0 ,&Purity/4FRt3SRqqt3FBt/event_proportion‚0 ?&Purity/1FRt2SRqqt1FBt/event_proportion‚0.008946572430431843 7 Purity/3FRt0SRqqt2FBt/FRt_purity‚0.6666666865348816 & Purity/*FRt1SRqqt4FBt/FRt_purity‚0 8"Purity/0FRt*SRqqt3FBt/SRqqt_purity‚0.699999988079071 7 Purity/0FRt2SRqqt3FBt/FBt_purity‚0.6666666865348816 & Purity/4FRt0SRqqt*FBt/FRt_purity‚0 9"Purity/*FRt1SRqqt*FBt/event_purity‚0.1757984608411789 9"Purity/1FRt*SRqqt1FBt/SRqqt_purity‚0.5671088695526123 9"Purity/1FRt3SRqqt2FBt/SRqqt_purity‚0.3333333432674408 :"Purity/*FRt2SRqqt*FBt/event_purity‚0.01822051778435707 :"Purity/0FRt2SRqqt0FBt/SRqqt_purity‚0.38525477051734924 8 Purity/2FRt*SRqqt0FBt/FRt_purity‚0.23757478594779968 :"Purity/2FRt4SRqqt0FBt/SRqqt_purity‚0.05000000074505806 +"Purity/3FRt4SRqqt*FBt/SRqqt_purity‚0.25 :"Purity/2FRt3SRqqt0FBt/SRqqt_purity‚0.34816014766693115 9"Purity/3FRt2SRqqt*FBt/SRqqt_purity‚0.5260416865348816 +particle/specificity‚0.9445048570632935 & Purity/1FRt*SRqqt4FBt/FRt_purity‚0 ,&Purity/*FRt3SRqqt4FBt/event_proportion‚0 9"Purity/0FRt*SRqqt1FBt/event_purity‚0.6523815989494324 9"Purity/0FRt1SRqqt2FBt/SRqqt_purity‚0.4685317277908325 ?&Purity/2FRt0SRqqt*FBt/event_proportion‚0.037046369165182114 @&Purity/4FRt2SRqqt*FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_5‚1 ;"Purity/0FRt3SRqqt*FBt/event_purity‚0.003968254197388887 6 Purity/3FRt3SRqqt*FBt/FRt_purity‚0.190476194024086 ?&Purity/*FRt1SRqqt2FBt/event_proportion‚0.017011089250445366 A&Purity/0FRt*SRqqt4FBt/event_proportion‚0.00025201612152159214 7 Purity/1FRt*SRqqt1FBt/FRt_purity‚0.3748592436313629 ;"Purity/2FRt1SRqqt*FBt/event_purity‚0.004274473991245031 :"Purity/3FRt0SRqqt*FBt/event_purity‚0.03787878900766373 jet/accuracy_6_of_6‚0 9"Purity/*FRt3SRqqt*FBt/SRqqt_purity‚0.3769434988498688 @&Purity/0FRt3SRqqt1FBt/event_proportion‚0.0006300403038039804 ;"Purity/1FRt2SRqqt1FBt/event_purity‚0.014285714365541935 @&Purity/4FRt1SRqqt0FBt/event_proportion‚6.300403038039804e-05 9"Purity/1FRt0SRqqt3FBt/event_purity‚0.1785714328289032 & Purity/2FRt*SRqqt1FBt/FBt_purity‚1 7 Purity/*FRt4SRqqt*FBt/FRt_purity‚0.2222222238779068 ("Purity/1FRt3SRqqt2FBt/event_purity‚0 7"Purity/*FRt3SRqqt1FBt/SRqqt_purity‚0.39682537317276 ("Purity/2FRt3SRqqt*FBt/event_purity‚0 +jet/accuracy_2_of_2‚0.11173839867115021 ( Purity/*FRt1SRqqt3FBt/FRt_purity‚0.5 ;"Purity/2FRt*SRqqt2FBt/event_purity‚0.017777778208255768 7 Purity/2FRt1SRqqt*FBt/FRt_purity‚0.2850809395313263 ,&Purity/4FRt2SRqqt4FBt/event_proportion‚0 ;"Purity/0FRt1SRqqt2FBt/event_purity‚0.056111108511686325 :"Purity/1FRt0SRqqt1FBt/event_purity‚0.31550338864326477 @&Purity/3FRt0SRqqt1FBt/event_proportion‚0.0011340725468471646 ,&Purity/3FRt4SRqqt1FBt/event_proportion‚0 /"Purity/*FRt4SRqqt*FBt/SRqqt_purity‚0.265625 & Purity/*FRt4SRqqt*FBt/FBt_purity‚1 =&Purity/0FRt1SRqqt*FBt/event_proportion‚0.2305317521095276 + Purity/1FRt*SRqqt3FBt/FRt_purity‚0.6875 9"Purity/2FRt1SRqqt1FBt/SRqqt_purity‚0.6129416823387146 ?&Purity/2FRt1SRqqt2FBt/event_proportion‚0.001890120911411941 ("Purity/4FRt1SRqqt0FBt/event_purity‚0 7 Purity/0FRt0SRqqt2FBt/FBt_purity‚0.9872635006904602 =&Purity/0FRt1SRqqt0FBt/event_proportion‚0.1694808453321457 7 Purity/2FRt1SRqqt*FBt/FBt_purity‚0.9964157938957214 ?&Purity/2FRt2SRqqt*FBt/event_proportion‚0.019468246027827263 ,&Purity/4FRt4SRqqt3FBt/event_proportion‚0 >&Purity/0FRt*SRqqt0FBt/event_proportion‚0.21931703388690948 :"Purity/*FRt1SRqqt1FBt/event_purity‚0.12027335911989212 ,&Purity/4FRt4SRqqt2FBt/event_proportion‚0 >&Purity/*FRt2SRqqt1FBt/event_proportion‚0.02255544438958168 >&Purity/0FRt1SRqqt1FBt/event_proportion‚0.05185231938958168 9"Purity/1FRt3SRqqt0FBt/SRqqt_purity‚0.3900153338909149 9"Purity/3FRt1SRqqt*FBt/SRqqt_purity‚0.4660494029521942 ("Purity/3FRt1SRqqt1FBt/event_purity‚0 ,&Purity/3FRt2SRqqt2FBt/event_proportion‚0 ,&Purity/3FRt2SRqqt3FBt/event_proportion‚0 *jet/accuracy_2_of_4‚0.3542517423629761 7 Purity/0FRt0SRqqt1FBt/FBt_purity‚0.9993913769721985 @&Purity/1FRt4SRqqt*FBt/event_proportion‚0.0003780241822823882 ;"Purity/3FRt*SRqqt*FBt/event_purity‚0.008192525245249271 ,&Purity/4FRt*SRqqt4FBt/event_proportion‚0 ("Purity/*FRt0SRqqt4FBt/event_purity‚0 7 Purity/*FRt4SRqqt0FBt/FRt_purity‚0.2222222238779068 ( Purity/2FRt2SRqqt2FBt/FRt_purity‚0.5 ("Purity/4FRt2SRqqt*FBt/SRqqt_purity‚1 :"Purity/*FRt*SRqqt2FBt/event_purity‚0.18759259581565857 ;"Purity/*FRt2SRqqt0FBt/event_purity‚0.017474550753831863 A&Purity/1FRt1SRqqt3FBt/event_proportion‚0.00025201612152159214 ,&Purity/1FRt4SRqqt4FBt/event_proportion‚0 ?&Purity/2FRt3SRqqt*FBt/event_proportion‚0.004032257944345474 :"Purity/*FRt2SRqqt2FBt/SRqqt_purity‚0.49561405181884766 ("Purity/1FRt2SRqqt2FBt/event_purity‚0 ("Purity/0FRt0SRqqt0FBt/event_purity‚1 7 Purity/2FRt1SRqqt0FBt/FRt_purity‚0.2607961595058441 *jet/accuracy_2_of_3‚0.2415509670972824 ("Purity/0FRt1SRqqt3FBt/event_purity‚0 8"Purity/3FRt3SRqqt*FBt/SRqqt_purity‚0.523809552192688 ("Purity/0FRt2SRqqt3FBt/SRqqt_purity‚1 7 Purity/1FRt1SRqqt1FBt/FRt_purity‚0.2984892725944519 ,&Purity/2FRt4SRqqt1FBt/event_proportion‚0 ,jet/accuracy_4_of_4‚0.009291778318583965 ("Purity/0FRt2SRqqt2FBt/event_purity‚0 :"Purity/*FRt0SRqqt0FBt/event_purity‚0.18464043736457825 ,&Purity/0FRt4SRqqt4FBt/event_proportion‚0 :"Purity/0FRt1SRqqt1FBt/event_purity‚0.19496546685695648 ,&Purity/1FRt3SRqqt3FBt/event_proportion‚0 7 Purity/2FRt*SRqqt2FBt/FBt_purity‚0.9911110997200012 ("Purity/2FRt2SRqqt*FBt/event_purity‚0 ,&Purity/4FRt1SRqqt4FBt/event_proportion‚0 *jet/accuracy_1_of_2‚0.7204058766365051 & Purity/1FRt1SRqqt4FBt/FRt_purity‚0 ("Purity/4FRt1SRqqt*FBt/event_purity‚0 >&Purity/1FRt*SRqqt1FBt/event_proportion‚0.09929435700178146 @&Purity/3FRt3SRqqt*FBt/event_proportion‚0.0005670362734235823 particle/accuracy_4_of_4‚1 ("Purity/1FRt*SRqqt4FBt/event_purity‚0 ("Purity/1FRt4SRqqt0FBt/event_purity‚0 ("Purity/4FRt*SRqqt*FBt/event_purity‚0 ("Purity/4FRt0SRqqt*FBt/event_purity‚0 9"Purity/*FRt*SRqqt*FBt/event_purity‚0.2347685694694519 9"Purity/*FRt*SRqqt1FBt/SRqqt_purity‚0.5529438853263855 9"Purity/*FRt*SRqqt2FBt/SRqqt_purity‚0.5409764051437378 ("Purity/*FRt2SRqqt2FBt/event_purity‚0 9"Purity/1FRt2SRqqt2FBt/SRqqt_purity‚0.4305555820465088 *"Purity/4FRt*SRqqt0FBt/SRqqt_purity‚0.5 >&Purity/0FRt*SRqqt1FBt/event_proportion‚0.14787046611309052 :"Purity/1FRt2SRqqt0FBt/SRqqt_purity‚0.40232181549072266 7 Purity/2FRt*SRqqt*FBt/FBt_purity‚0.9961161017417908 :"Purity/0FRt3SRqqt0FBt/SRqqt_purity‚0.33273813128471375 ("Purity/*FRt1SRqqt4FBt/event_purity‚0 & Purity/4FRt0SRqqt0FBt/FRt_purity‚0 :"Purity/0FRt0SRqqt3FBt/event_purity‚0.11999999731779099 @&Purity/3FRt1SRqqt0FBt/event_proportion‚0.0025201612152159214 @&Purity/3FRt2SRqqt*FBt/event_proportion‚0.0028351815417408943 ,&Purity/4FRt0SRqqt3FBt/event_proportion‚0 epoch‚9 ?&Purity/0FRt3SRqqt*FBt/event_proportion‚0.006741431541740894 @&Purity/3FRt0SRqqt0FBt/event_proportion‚0.0015120967291295528 ,&Purity/4FRt3SRqqt2FBt/event_proportion‚0 ("Purity/*FRt1SRqqt3FBt/event_purity‚0 7 Purity/2FRt*SRqqt*FBt/FRt_purity‚0.2757412791252136 7"Purity/2FRt2SRqqt1FBt/SRqqt_purity‚0.62797611951828 *jet/accuracy_1_of_4‚0.9055361151695251 & Purity/*FRt4SRqqt1FBt/FBt_purity‚1 ("Purity/*FRt*SRqqt4FBt/SRqqt_purity‚1 ("Purity/1FRt1SRqqt4FBt/SRqqt_purity‚1 ,&Purity/*FRt2SRqqt4FBt/event_proportion‚0 >&Purity/0FRt*SRqqt2FBt/event_proportion‚0.03944052383303642 @&Purity/1FRt3SRqqt2FBt/event_proportion‚6.300403038039804e-05 9"Purity/3FRt1SRqqt0FBt/SRqqt_purity‚0.3749999701976776 particle/accuracy_1_of_4‚1 ("Purity/*FRt2SRqqt3FBt/event_purity‚0 $ _timestamp‚1.788485158677078e+09 =&Purity/*FRt0SRqqt2FBt/event_proportion‚0.0483240932226181 9"Purity/0FRt*SRqqt*FBt/SRqqt_purity‚0.4089757204055786 & Purity/2FRt1SRqqt1FBt/FBt_purity‚1 jet/accuracy_5_of_6‚0 9"Purity/0FRt2SRqqt2FBt/SRqqt_purity‚0.4615384638309479 6 Purity/3FRt3SRqqt0FBt/FRt_purity‚0.190476194024086 ( Purity/1FRt1SRqqt3FBt/FRt_purity‚0.5 7 Purity/*FRt3SRqqt1FBt/FRt_purity‚0.2944444417953491 @&Purity/*FRt4SRqqt1FBt/event_proportion‚6.300403038039804e-05 ;"Purity/3FRt*SRqqt1FBt/event_purity‚0.024242425337433815 @&Purity/4FRt0SRqqt0FBt/event_proportion‚6.300403038039804e-05 particle/accuracy_1_of_1‚1 particle/accuracy_4_of_5‚1 ("Purity/0FRt*SRqqt4FBt/event_purity‚0 8 Purity/*FRt2SRqqt2FBt/FRt_purity‚0.24358974397182465 6 Purity/0FRt*SRqqt3FBt/FBt_purity‚0.897119402885437 :"Purity/1FRt2SRqqt*FBt/SRqqt_purity‚0.42251327633857727 8 Purity/2FRt1SRqqt1FBt/FRt_purity‚0.32062214612960815 ?&Purity/3FRt*SRqqt*FBt/event_proportion‚0.009954636916518211 particle/accuracy_3_of_6‚1 ,"Purity/1FRt4SRqqt*FBt/SRqqt_purity‚0.375 ("Purity/3FRt0SRqqt2FBt/event_purity‚0 7 Purity/*FRt1SRqqt2FBt/FBt_purity‚0.9871938228607178 6 Purity/*FRt3SRqqt1FBt/FBt_purity‚0.976190447807312 A&Purity/1FRt*SRqqt4FBt/event_proportion‚0.00012600806076079607 * Purity/0FRt*SRqqt4FBt/FBt_purity‚0.875 7 Purity/1FRt*SRqqt2FBt/FBt_purity‚0.9691274762153625 @&Purity/2FRt*SRqqt3FBt/event_proportion‚6.300403038039804e-05 7 Purity/2FRt0SRqqt2FBt/FRt_purity‚0.5595238208770752 >&Purity/0FRt0SRqqt*FBt/event_proportion‚0.11857359111309052 A&Purity/0FRt0SRqqt4FBt/event_proportion‚0.00025201612152159214 9"Purity/1FRt*SRqqt2FBt/SRqqt_purity‚0.5654249787330627 8 Purity/1FRt1SRqqt0FBt/FRt_purity‚0.24410425126552582 8"Purity/0FRt1SRqqt3FBt/SRqqt_purity‚0.699999988079071 ("Purity/0FRt2SRqqt3FBt/event_purity‚0 7 Purity/*FRt0SRqqt3FBt/FBt_purity‚0.9236111640930176 :"Purity/0FRt1SRqqt*FBt/SRqqt_purity‚0.41642460227012634 @&Purity/1FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 :"Purity/2FRt0SRqqt2FBt/event_purity‚0.02500000037252903 ("Purity/4FRt0SRqqt0FBt/event_purity‚0 ,&Purity/*FRt4SRqqt2FBt/event_proportion‚0 9"Purity/0FRt0SRqqt*FBt/event_purity‚0.8119551539421082 =&Purity/1FRt1SRqqt0FBt/event_proportion‚0.1265120953321457 7 Purity/*FRt0SRqqt4FBt/FBt_purity‚0.8999999761581421 ("Purity/2FRt3SRqqt1FBt/event_purity‚0 ) Purity/4FRt*SRqqt*FBt/FRt_purity‚0.25 ("Purity/4FRt1SRqqt0FBt/SRqqt_purity‚0 & Purity/1FRt1SRqqt1FBt/FBt_purity‚1 *jet/accuracy_1_of_6‚0.9210526347160339 8 Purity/*FRt1SRqqt*FBt/FRt_purity‚0.26919135451316833 @&Purity/*FRt4SRqqt*FBt/event_proportion‚0.0013230846961960196 ,&Purity/2FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/3FRt1SRqqt4FBt/event_proportion‚0 particle/accuracy_2_of_2‚1 7 Purity/1FRt2SRqqt2FBt/FRt_purity‚0.2222222238779068 9"Purity/*FRt0SRqqt1FBt/event_purity‚0.7038219571113586 ?&Purity/0FRt0SRqqt2FBt/event_proportion‚0.029674898833036423 8"Purity/1FRt*SRqqt*FBt/SRqqt_purity‚0.433145135641098 ?&Purity/1FRt*SRqqt2FBt/event_proportion‚0.022303426638245583 ,&Purity/4FRt4SRqqt*FBt/event_proportion‚0 8"Purity/3FRt3SRqqt0FBt/SRqqt_purity‚0.523809552192688 7 Purity/1FRt*SRqqt*FBt/FBt_purity‚0.9923309087753296 =&Purity/1FRt1SRqqt*FBt/event_proportion‚0.1723790317773819 A&Purity/3FRt4SRqqt*FBt/event_proportion‚0.00012600806076079607 jet/accuracy_2_of_7‚0.5 ("Purity/*FRt2SRqqt3FBt/SRqqt_purity‚1 7 Purity/*FRt1SRqqt*FBt/FBt_purity‚0.9930368065834045 :"Purity/1FRt0SRqqt0FBt/event_purity‚0.21900708973407745 @&Purity/2FRt2SRqqt2FBt/event_proportion‚6.300403038039804e-05 ,&Purity/4FRt2SRqqt3FBt/event_proportion‚0 particle/accuracy_2_of_7‚1 9"Purity/*FRt1SRqqt3FBt/SRqqt_purity‚0.7380952835083008 7 Purity/*FRt*SRqqt2FBt/FRt_purity‚0.5106716752052307 8 Purity/*FRt3SRqqt0FBt/FRt_purity‚0.18622857332229614 :"Purity/0FRt2SRqqt0FBt/event_purity‚0.04309696704149246 6 Purity/1FRt*SRqqt*FBt/FRt_purity‚0.277937650680542 7 Purity/1FRt0SRqqt3FBt/FBt_purity‚0.9523809552192688 :"Purity/1FRt3SRqqt1FBt/SRqqt_purity‚0.46666666865348816 ("Purity/2FRt4SRqqt0FBt/event_purity‚0 & Purity/1FRt3SRqqt2FBt/FRt_purity‚0 =&Purity/1FRt*SRqqt*FBt/event_proportion‚0.4366179406642914 9"Purity/1FRt*SRqqt2FBt/event_purity‚0.0821954682469368 ("Purity/2FRt3SRqqt0FBt/event_purity‚0 & Purity/1FRt0SRqqt4FBt/FBt_purity‚1 @&Purity/*FRt0SRqqt4FBt/event_proportion‚0.0003150201519019902 8 Purity/*FRt2SRqqt*FBt/FRt_purity‚0.22187818586826324 7 Purity/0FRt*SRqqt1FBt/FBt_purity‚0.9976283311843872 7 Purity/0FRt1SRqqt2FBt/FBt_purity‚0.9870370030403137 ("Purity/1FRt1SRqqt2FBt/event_purity‚0 <"Purity/1FRt2SRqqt*FBt/event_purity‚0.0033122121822088957 7 Purity/2FRt0SRqqt*FBt/FBt_purity‚0.9967741966247559 ,&Purity/2FRt4SRqqt2FBt/event_proportion‚0 8 Purity/1FRt0SRqqt0FBt/FRt_purity‚0.21900708973407745 ?&Purity/2FRt3SRqqt0FBt/event_proportion‚0.003654233878478408 ("Purity/1FRt4SRqqt*FBt/event_purity‚0 @&Purity/*FRt1SRqqt4FBt/event_proportion‚6.300403038039804e-05 ,&Purity/*FRt4SRqqt4FBt/event_proportion‚0 ,&Purity/4FRt2SRqqt1FBt/event_proportion‚0 ("Purity/0FRt4SRqqt1FBt/event_purity‚0 & Purity/3FRt2SRqqt*FBt/FBt_purity‚1 +jet/accuracy_3_of_6‚0.12280702590942383 7 Purity/1FRt2SRqqt2FBt/FBt_purity‚0.9444444179534912 particle/accuracy_5_of_7‚1 ?&Purity/*FRt0SRqqt3FBt/event_proportion‚0.003717237850651145 9"Purity/2FRt*SRqqt1FBt/event_purity‚0.0347873717546463 particle/accuracy_6_of_6‚1 jet/accuracy_6_of_7‚0 7 Purity/*FRt0SRqqt1FBt/FBt_purity‚0.9996017217636108 :"Purity/0FRt1SRqqt*FBt/event_purity‚0.32247933745384216 ,&Purity/0FRt4SRqqt3FBt/event_proportion‚0 >&Purity/1FRt0SRqqt0FBt/event_proportion‚0.13142640888690948 8 Purity/3FRt*SRqqt0FBt/FRt_purity‚0.21037037670612335 & Purity/3FRt1SRqqt1FBt/FBt_purity‚1 ("Purity/3FRt2SRqqt1FBt/event_purity‚0 +jet/accuracy_4_of_6‚0.02631578966975212 7 Purity/*FRt*SRqqt2FBt/FBt_purity‚0.9872506856918335 7 Purity/*FRt2SRqqt*FBt/FBt_purity‚0.9854983687400818 7 Purity/2FRt0SRqqt*FBt/FRt_purity‚0.3017336428165436 ,"Purity/0FRt3SRqqt1FBt/event_purity‚0.125 & Purity/1FRt3SRqqt2FBt/FBt_purity‚1 8"Purity/0FRt2SRqqt1FBt/SRqqt_purity‚0.539644181728363 >&Purity/1FRt1SRqqt1FBt/event_proportion‚0.03944052383303642 9"Purity/2FRt1SRqqt2FBt/SRqqt_purity‚0.7412280440330505 ("Purity/3FRt*SRqqt0FBt/event_purity‚0 particle/accuracy_1_of_7‚1 particle/accuracy_6_of_7‚1 ("Purity/3FRt*SRqqt2FBt/event_purity‚0 8 Purity/3FRt2SRqqt*FBt/FRt_purity‚0.23611114919185638 (particle/accuracy‚0.8493573665618896 jet/accuracy_5_of_7‚0 & Purity/4FRt2SRqqt0FBt/FRt_purity‚0 8 Purity/*FRt1SRqqt2FBt/FRt_purity‚0.40809592604637146 :"Purity/1FRt*SRqqt*FBt/event_purity‚0.11658094823360443 7 Purity/1FRt2SRqqt*FBt/FRt_purity‚0.2255040407180786 ("Purity/*FRt4SRqqt1FBt/event_purity‚0 & Purity/2FRt3SRqqt*FBt/FBt_purity‚1 8 Purity/*FRt0SRqqt0FBt/FRt_purity‚0.22307731211185455 A&Purity/0FRt1SRqqt3FBt/event_proportion‚0.00044102821266278625 & Purity/3FRt*SRqqt1FBt/FBt_purity‚1 8 Purity/3FRt0SRqqt1FBt/FRt_purity‚0.49358975887298584 8 Purity/3FRt1SRqqt0FBt/FRt_purity‚0.19722223281860352 particle/accuracy_2_of_6‚1 7 Purity/*FRt*SRqqt*FBt/FBt_purity‚0.9915515780448914 9"Purity/1FRt1SRqqt2FBt/SRqqt_purity‚0.6044217348098755 & Purity/1FRt3SRqqt*FBt/FBt_purity‚1 ,&Purity/3FRt4SRqqt3FBt/event_proportion‚0 8 Purity/2FRt4SRqqt*FBt/FRt_purity‚0.20000000298023224 7 Purity/*FRt2SRqqt2FBt/FBt_purity‚0.9649122357368469 7 Purity/1FRt1SRqqt3FBt/FBt_purity‚0.9166666865348816 ,&Purity/0FRt3SRqqt2FBt/event_proportion‚0 ,&Purity/0FRt3SRqqt4FBt/event_proportion‚0 >&Purity/2FRt1SRqqt*FBt/event_proportion‚0.04158266261219978 ,&Purity/2FRt1SRqqt3FBt/event_proportion‚0 ) Purity/1FRt1SRqqt4FBt/FBt_purity‚0.75 @&Purity/0FRt2SRqqt3FBt/event_proportion‚6.300403038039804e-05 & Purity/1FRt0SRqqt1FBt/FBt_purity‚1 ,&Purity/1FRt4SRqqt2FBt/event_proportion‚0 >&Purity/2FRt*SRqqt*FBt/event_proportion‚0.10244455933570862 >&Purity/2FRt1SRqqt0FBt/event_proportion‚0.03181703761219978 ("Purity/2FRt1SRqqt2FBt/event_purity‚0 ,&Purity/4FRt0SRqqt1FBt/event_proportion‚0 +"Purity/3FRt*SRqqt2FBt/SRqqt_purity‚0.75 >&Purity/0FRt0SRqqt0FBt/event_proportion‚0.04082661122083664 ?&Purity/0FRt3SRqqt0FBt/event_proportion‚0.006111391354352236 :"Purity/1FRt0SRqqt2FBt/event_purity‚0.12468495219945908 7 Purity/1FRt2SRqqt*FBt/FBt_purity‚0.9774298071861267 7 Purity/2FRt3SRqqt*FBt/FRt_purity‚0.2111428678035736 :"Purity/3FRt0SRqqt1FBt/event_purity‚0.11538461595773697 ,particle/sensitivity‚0.33528053760528564 _runtime‚6810.789576298 ,&Purity/1FRt2SRqqt3FBt/event_proportion‚0 ("Purity/2FRt2SRqqt0FBt/event_purity‚0 ,&Purity/2FRt3SRqqt2FBt/event_proportion‚0 9"Purity/*FRt*SRqqt3FBt/SRqqt_purity‚0.7380952835083008 7 Purity/*FRt*SRqqt*FBt/FRt_purity‚0.2767771780490875 ;"Purity/*FRt2SRqqt1FBt/event_purity‚0.023211775347590446 7 Purity/0FRt1SRqqt*FBt/FBt_purity‚0.9921841025352478 7 Purity/1FRt*SRqqt2FBt/FRt_purity‚0.5352205038070679 ;"Purity/1FRt1SRqqt0FBt/event_purity‚0.017829131335020065 :"Purity/1FRt1SRqqt1FBt/event_purity‚0.04873674362897873 8 Purity/1FRt3SRqqt*FBt/FRt_purity‚0.19251154363155365 ;"Purity/2FRt0SRqqt*FBt/event_purity‚0.027697117999196053 :"Purity/*FRt0SRqqt*FBt/event_purity‚0.40485435724258423 7 Purity/1FRt0SRqqt1FBt/FRt_purity‚0.4546416699886322 7 Purity/2FRt0SRqqt2FBt/FBt_purity‚0.9940475821495056 8 Purity/2FRt2SRqqt*FBt/FRt_purity‚0.20338580012321472 ("Purity/3FRt2SRqqt0FBt/event_purity‚0 ,&Purity/3FRt4SRqqt2FBt/event_proportion‚0 9"Purity/1FRt*SRqqt1FBt/event_purity‚0.1782359480857849 & Purity/0FRt4SRqqt*FBt/FBt_purity‚1 ("Purity/3FRt3SRqqt*FBt/event_purity‚0 7 Purity/*FRt0SRqqt3FBt/FRt_purity‚0.6666666865348816 ("Purity/*FRt3SRqqt0FBt/event_purity‚0 :"Purity/1FRt0SRqqt*FBt/event_purity‚0.23561827838420868 ;"Purity/2FRt0SRqqt1FBt/event_purity‚0.059947095811367035 ("Purity/3FRt0SRqqt0FBt/event_purity‚0 ("Purity/3FRt1SRqqt*FBt/event_purity‚0 +"Purity/*FRt4SRqqt0FBt/SRqqt_purity‚0.25 * Purity/0FRt0SRqqt4FBt/FBt_purity‚0.875 ?&Purity/0FRt0SRqqt3FBt/event_proportion‚0.002583165420219302 7 Purity/0FRt0SRqqt3FBt/FBt_purity‚0.9177778363227844 7 Purity/0FRt2SRqqt*FBt/FBt_purity‚0.9784946441650391 9"Purity/3FRt*SRqqt*FBt/SRqqt_purity‚0.4484948217868805 ("Purity/*FRt*SRqqt4FBt/event_purity‚0 ("Purity/0FRt0SRqqt4FBt/event_purity‚0 particle/accuracy_1_of_6‚1 jet/accuracy_4_of_7‚0 8"Purity/0FRt*SRqqt1FBt/SRqqt_purity‚0.528753399848938 ?&Purity/0FRt1SRqqt2FBt/event_proportion‚0.008757560513913631 9"Purity/1FRt*SRqqt0FBt/SRqqt_purity‚0.3941928744316101 9"Purity/2FRt2SRqqt*FBt/SRqqt_purity‚0.4947195053100586 ,&Purity/3FRt*SRqqt4FBt/event_proportion‚0 7 Purity/1FRt4SRqqt0FBt/FRt_purity‚0.1666666716337204 ("Purity/1FRt1SRqqt4FBt/event_purity‚0 ("Purity/4FRt1SRqqt*FBt/SRqqt_purity‚0 ?&Purity/1FRt3SRqqt*FBt/event_proportion‚0.009135584346950054 & Purity/2FRt2SRqqt*FBt/FBt_purity‚1 @&Purity/3FRt*SRqqt0FBt/event_proportion‚0.0071824598126113415 8 Purity/3FRt*SRqqt1FBt/FRt_purity‚0.33560606837272644 & Purity/3FRt0SRqqt1FBt/FBt_purity‚1 & Purity/1FRt0SRqqt4FBt/FRt_purity‚0 ("Purity/2FRt*SRqqt3FBt/event_purity‚0 ("Purity/2FRt0SRqqt3FBt/event_purity‚0 @&Purity/*FRt1SRqqt3FBt/event_proportion‚0.0006930443341843784 =&Purity/*FRt2SRqqt*FBt/event_proportion‚0.1332535296678543 9"Purity/0FRt0SRqqt1FBt/event_purity‚0.9993913769721985 >&Purity/1FRt0SRqqt*FBt/event_proportion‚0.19745463132858276 particle/accuracy_7_of_7‚1 + Purity/0FRt3SRqqt*FBt/FBt_purity‚0.9375 ("Purity/*FRt1SRqqt4FBt/SRqqt_purity‚1 *"Purity/4FRt*SRqqt*FBt/SRqqt_purity‚0.5 9"Purity/0FRt0SRqqt2FBt/event_purity‚0.3369482755661011 @&Purity/1FRt0SRqqt3FBt/event_proportion‚0.0010710685746744275 ?&Purity/2FRt2SRqqt0FBt/event_proportion‚0.015435988083481789 )loss/val_total_loss‚37.49732104489475 9"Purity/*FRt*SRqqt0FBt/SRqqt_purity‚0.3857136368751526 :"Purity/*FRt*SRqqt3FBt/event_purity‚0.07183908671140671 8 Purity/*FRt0SRqqt1FBt/FRt_purity‚0.44517838954925537 :"Purity/*FRt1SRqqt0FBt/event_purity‚0.20077352225780487 :"Purity/*FRt3SRqqt1FBt/event_purity‚0.02380952425301075 ,&Purity/2FRt2SRqqt4FBt/event_proportion‚0 8 Purity/3FRt0SRqqt0FBt/FRt_purity‚0.22549018263816833 =&Purity/*FRt0SRqqt*FBt/event_proportion‚0.3558467626571655 9"Purity/2FRt*SRqqt0FBt/SRqqt_purity‚0.3885573446750641 8 Purity/3FRt1SRqqt1FBt/FRt_purity‚0.25641027092933655 particle/accuracy_3_of_4‚1 ("Purity/3FRt4SRqqt0FBt/event_purity‚0 7 Purity/3FRt4SRqqt0FBt/FRt_purity‚0.3333333432674408 ("Purity/1FRt*SRqqt4FBt/SRqqt_purity‚1éíyƒRÉ dnrp7hvvj@ ¦¼èÔ ¦è0`Trainer.fit` stopped: `max_epochs=10` reached. ò?q£Ê dnrp7hvvj ¨¼èÔðý£®~Epoch 9/9 â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â” 604/604 0:11:16 • 0:00:00 0.91it/s v_num: 7hvv]wBÿ%Ë dnrp7hvvj ¨¼èÔ »´® è|H,2Ì- _wandbruntime‚6814  _runtime‚6814[äYÍ‚(’ž5