Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 838.69959ms FAIL (2025-08-07 13:25:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 838.738334ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.406179412s FAIL (2025-08-07 13:25:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.40621328s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.453706907s FAIL (2025-08-07 13:24:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.453733057s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.086775087s FAIL (2025-08-07 13:24:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.08680026s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 3.106720076s FAIL (2025-08-07 13:23:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 3.1067496s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.083987201s FAIL (2025-08-07 13:23:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.084019439s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 929.723585ms FAIL (2025-08-07 13:22:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 929.755783ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.551977172s FAIL (2025-08-07 13:22:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.552011207s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.000458159s FAIL (2025-08-07 13:22:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.000486753s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.617017261s FAIL (2025-08-07 13:21:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.617048381s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.217430128s FAIL (2025-08-07 13:21:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 2.217460929s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.41594198s FAIL (2025-08-07 13:20:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.415975158s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.134760608s FAIL (2025-08-07 13:20:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.134791969s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.236777627s FAIL (2025-08-07 13:19:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.236810112s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.551309906s FAIL (2025-08-07 13:19:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.551342849s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.421934765s FAIL (2025-08-07 13:19:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.421963223s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.915352658s FAIL (2025-08-07 13:19:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.91540448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.052494611s FAIL (2025-08-07 13:18:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.052538975s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 3.124823632s FAIL (2025-08-07 13:18:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 3.124862098s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.509047429s FAIL (2025-08-07 13:17:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.509084451s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 990.557959ms FAIL (2025-08-07 13:17:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 990.594644ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.646392269s FAIL (2025-08-07 13:16:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.646439719s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 906.556889ms FAIL (2025-08-07 13:16:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 906.588123ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.36704124s FAIL (2025-08-07 13:15:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.367079705s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.108682261s FAIL (2025-08-07 13:15:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.108726651s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.010623486s FAIL (2025-08-07 13:15:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.010661101s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.46667088s FAIL (2025-08-07 13:14:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.466699133s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.128492314s FAIL (2025-08-07 13:14:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.128525477s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.456678393s FAIL (2025-08-07 13:13:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.456701229s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.511480499s FAIL (2025-08-07 13:13:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.511580119s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 948.619486ms FAIL (2025-08-07 13:13:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 948.659145ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.310608913s FAIL (2025-08-07 13:12:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.310639591s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.253184281s FAIL (2025-08-07 13:12:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.253217364s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 3.357781757s FAIL (2025-08-07 13:11:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 3.357827496s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.429279339s FAIL (2025-08-07 13:11:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.429330432s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.032047244s FAIL (2025-08-07 13:11:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.032114889s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 872.374705ms FAIL (2025-08-07 13:10:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 872.403856ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.43249369s FAIL (2025-08-07 13:10:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.432526334s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.372991942s FAIL (2025-08-07 13:10:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.373023463s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.371886118s FAIL (2025-08-07 13:09:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.371915922s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 891.736553ms FAIL (2025-08-07 13:09:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 891.840016ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.484661444s FAIL (2025-08-07 13:08:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 2.484691633s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 943.083969ms FAIL (2025-08-07 13:08:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 943.107806ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1.654465713s FAIL (2025-08-07 13:07:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 8m13.439648408s) [upload=3614]: Done starting upload Aug 7 13:07:51.695838283 (3h28m13.439895131s) [upload=3614]: Uploading segments... Aug 7 13:07:51.695885595 (3h28m13.439942467s) [upload=3614]: Got next segment. Inline: false Aug 7 13:07:51.695919699 (3h28m13.43997656s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 13:07:51.695924923 (3h28m13.439981784s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 13:07:51.896435571 (3h28m13.640492433s) [seg_pos={0 0}, upload=3614]: Begin upload segment... Aug 7 13:07:51.896493651 (3h28m13.640550501s) [seg_pos={0 0}, upload=3614]: Done begin upload segment. Aug 7 13:07:51.896517941 (3h28m13.640574813s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896528823 (3h28m13.640585687s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896886878 (3h28m13.640943774s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.896989239 (3h28m13.641046102s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897373263 (3h28m13.641430124s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.897838564 (3h28m13.641895424s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.902313624 (3h28m13.64637049s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.906387678 (3h28m13.650444576s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.910246223 (3h28m13.654303089s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914022955 (3h28m13.658079819s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.914620450 (3h28m13.658677318s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915243559 (3h28m13.659300429s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.915631418 (3h28m13.659688289s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916200065 (3h28m13.660256937s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.916669421 (3h28m13.660726288s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917050454 (3h28m13.661107327s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917520044 (3h28m13.661576912s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:51.917907784 (3h28m13.661964657s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Uploading piece... Aug 7 13:07:52.472185396 (3h28m14.216242242s) [upload=3614]: Next returned nil segment Aug 7 13:07:52.472203675 (3h28m14.216260522s) [upload=3614]: Waiting for error group managing segments... Aug 7 13:07:52.630449866 (3h28m14.374506716s) [noise=true , address=45.91.116.5:4325 , piece_id=HX2LOJIAB3TGYKOBLEJN5WGZITHIYOBG6DBCE6IYYQRFQDLTSOAQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.644550550 (3h28m14.38860741s) [noise=true , address=104.36.82.45:4910 , piece_id=LKWKS2IRPXM7E7A4NSBZBE4VMR2R6BF7Y67G6S4ZY3LDBMOO3SJQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.645615111 (3h28m14.38967199s) [noise=true , address=104.36.82.44:4879 , piece_id=2EZYPE7XD3FDCBB5QHPLO4NQ2BL52NKZBUXMLISVLWMMUNCFIAEQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648209065 (3h28m14.392265926s) [noise=true , address=104.36.82.46:4485 , piece_id=VXARZ6WOPSNLQIQRDOM5IPDV3L2BETPXJ3CBIONSD3N6OMXVG2NA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.648228971 (3h28m14.392285823s) [noise=true , address=104.36.82.2:4739 , piece_id=LHHEKUKRB6EQFSA7YBJW2PNUNPBSLF4UKFWOREYOMAHRJXX33CSQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.651278158 (3h28m14.395335019s) [noise=true , address=104.36.82.36:4629 , piece_id=DQAYRI2RH2OB6CCQOSS4L4HSX2PTKA23SGW6FFJNKLCI4YDQUGUA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.655159687 (3h28m14.399216541s) [noise=true , address=104.36.82.8:4974 , piece_id=FK5DIPU6ZEELB7AVPQHBULUTMQENLBAZXCD3ABGPL3JNLHYXC4HQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664489262 (3h28m14.408546116s) [noise=true , address=104.36.82.34:4549 , piece_id=K5FSR2F5B2K2EQNLIT4346GGITJLKYWRLSHPNXIJXEYG2HKEH4SA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.664995737 (3h28m14.409052588s) [noise=true , address=104.36.82.43:4844 , piece_id=FMSYQWIJ4WNJELJLDWXG53BFBTWXXHTP3ZHGSX6CEV54WKF4U6VA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.669395828 (3h28m14.413452688s) [noise=true , address=104.36.82.37:4670 , piece_id=W7F6BQZKLL27FEOUZEJWJWQ4XULNL2PZ6L2UPBUPRX5NBRLNZR3Q, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.670589484 (3h28m14.414646344s) [noise=true , address=104.36.82.60:4361 , piece_id=RLGTZP4SGTYGNP3BACXW5SGWBFXQSOPVJY5VWYC5UIVUVI4H5ZJA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.674615952 (3h28m14.418672815s) [noise=true , address=104.36.82.62:4415 , piece_id=CG3O77SLTIGQSMXNNZTR6N5GHKJ3YTE7VBX3ESTPSCC5C5QGJ3MQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.684593232 (3h28m14.42865008s) [noise=true , address=104.36.82.15:4280 , piece_id=NIW5LIXQPS6ZYPVZRG7KYRCTIZTS7O2LNK4XSTS6D25J6X5CETFQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687256589 (3h28m14.431313447s) [noise=true , address=104.36.82.14:4254 , piece_id=ST3566GBQWKTYCEP64JGPIOIXALUXWU5IQXVWTX2RBFWMDQJGXYQ, seg_pos={0 0}, upload=3614]: Done uploading piece. err: <nil> Aug 7 13:07:52.687308495 (3h28m14.431365362s) [seg_pos={0 0}, upload=3614]: Segment reached optimal threshold of 14 pieces. Aug 7 13:07:52.687555408 (3h28m14.431612273s) [noise=true , address=104.36.82.61:4384 , piece_id=7XJY4CUAAJGEZI54HFVTAXMR7NKGRZEKI7C6PNXBNZB5575ISYHA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FygMGuy8K7NzctYWRxRNmxZqrXNFfJLkNyHWLb4dhwumJKDkr): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687595080 (3h28m14.431651939s) [noise=true , address=104.36.82.54:4157 , piece_id=RFZBTZNLTPHZTPKYEG3HY6KKQ3CBMTPHV2CPUPSWNOK7HQWMDFGA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687634750 (3h28m14.431691614s) [noise=true , address=45.91.116.8:4074 , piece_id=BQX4WYC2YFUQ4BE4DT7EAOEWEXHT2QY6OA6QQUBIIC2XDHAKCFWA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12whTD1Kvu4T7ANNtkSvDB66uTjVgfPTK9TAzExgvwJYgZ3zSFG): protocol: expected piece hash; context canceled; EOF Aug 7 13:07:52.687757980 (3h28m14.431814847s) [noise=true , address=64.49.13.140:4510 , piece_id=LOW7TENMCF5HBSPHLV22YX6YBIMVUSSDYEK2AZ7OL5JZRILRCTTA, seg_pos={0 0}, upload=3614]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hmWsLV5jkkdh53WQaHCK9m7QQY6KBBZtrgZWbcSvWASWYFGJz): protocol: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:58190->64.49.13.140:4510: use of closed network connection Aug 7 13:07:52.687791263 (3h28m14.431848108s) [seg_pos={0 0}, upload=3614]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 13:07:52.687885272 (3h28m14.431942132s) [upload=3614]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 13:07:52.687891345 (3h28m14.431948205s) [upload=3614]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 13:07:52.853708528 (3h28m14.597765389s) [upload=3614]: Done uploading segments... Aug 7 13:07:52.853728576 (3h28m14.597785432s) [upload=3614]: Upload finished. err: <nil> Duration: 1.654485351s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.........................................X.................] duration: 833.368922ms FAIL (2025-08-07 13:07:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 833.401593ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X.........................................X................] duration: 1.230259494s FAIL (2025-08-07 13:07:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.230292464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.X.........................................X...............] duration: 862.06597ms FAIL (2025-08-07 13:06:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 862.160089ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.X.........................................X..............] duration: 1.965419464s FAIL (2025-08-07 13:05:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.965462905s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X.X.........................................X.............] duration: 837.963715ms FAIL (2025-08-07 13:05:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 837.9938ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X.X.........................................X............] duration: 1.007287003s FAIL (2025-08-07 13:04:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1d75bc93fcbe1ceb07bc776bfcd7b388ce6d7786462ab90d92cd58a272a49be2 != before ff3dcba61c45c6a15c1f64a6a073124cabfdf8ef9b5dd1d6a7cc4f51dc2577d4 ======LOGS====== sh batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:17.673775146 (3h7m39.417832006s) [upload=3254]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:17.824992619 (3h7m39.569049466s) [upload=3254]: Done uploading segments... Aug 7 12:47:17.825011331 (3h7m39.569068177s) [upload=3254]: Upload finished. err: <nil> Aug 7 12:48:29.703927074 (3h8m51.447983925s) [upload=3276]: Starting upload Aug 7 12:48:29.704001814 (3h8m51.448058684s) [upload=3276]: Done starting upload Aug 7 12:48:29.704100772 (3h8m51.44815764s) [upload=3276]: Uploading segments... Aug 7 12:48:29.705995128 (3h8m51.450051999s) [upload=3276]: Got next segment. Inline: true Aug 7 12:48:29.706021933 (3h8m51.450078805s) [upload=3276]: Waiting for error group managing segments... Aug 7 12:48:29.706110553 (3h8m51.450167427s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:29.706118778 (3h8m51.450175647s) [upload=3276]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:29.706124126 (3h8m51.450181004s) [upload=3276]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:29.850509004 (3h8m51.594565853s) [upload=3276]: Done uploading segments... Aug 7 12:48:29.850527782 (3h8m51.594584643s) [upload=3276]: Upload finished. err: <nil> Aug 7 12:48:56.748009095 (3h9m18.492065962s) [upload=3286]: Starting upload Aug 7 12:48:56.748081705 (3h9m18.492138573s) [upload=3286]: Done starting upload Aug 7 12:48:56.748181494 (3h9m18.492238348s) [upload=3286]: Uploading segments... Aug 7 12:48:56.748238916 (3h9m18.492295788s) [upload=3286]: Got next segment. Inline: true Aug 7 12:48:56.748246722 (3h9m18.492303597s) [upload=3286]: Waiting for error group managing segments... Aug 7 12:48:56.748294975 (3h9m18.492351889s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:56.748300976 (3h9m18.492357836s) [upload=3286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:56.748304378 (3h9m18.492361239s) [upload=3286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:56.910561214 (3h9m18.654618081s) [upload=3286]: Done uploading segments... Aug 7 12:48:56.910586047 (3h9m18.654642908s) [upload=3286]: Upload finished. err: <nil> Aug 7 12:49:23.045033975 (3h9m44.789090826s) [upload=3292]: Starting upload Aug 7 12:49:23.045126861 (3h9m44.789183725s) [upload=3292]: Done starting upload Aug 7 12:49:23.045262249 (3h9m44.789319098s) [upload=3292]: Uploading segments... Aug 7 12:49:23.045339683 (3h9m44.789396551s) [upload=3292]: Got next segment. Inline: true Aug 7 12:49:23.045345338 (3h9m44.789402198s) [upload=3292]: Waiting for error group managing segments... Aug 7 12:49:23.045402811 (3h9m44.78945967s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:23.045407761 (3h9m44.78946462s) [upload=3292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:23.045410695 (3h9m44.789467554s) [upload=3292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:23.211402452 (3h9m44.95545931s) [upload=3292]: Done uploading segments... Aug 7 12:49:23.211425754 (3h9m44.955482604s) [upload=3292]: Upload finished. err: <nil> Aug 7 12:49:56.525273662 (3h10m18.269330509s) [upload=3303]: Starting upload Aug 7 12:49:56.525350221 (3h10m18.269407092s) [upload=3303]: Done starting upload Aug 7 12:49:56.525441544 (3h10m18.269498392s) [upload=3303]: Uploading segments... Aug 7 12:49:56.525505858 (3h10m18.269562728s) [upload=3303]: Got next segment. Inline: true Aug 7 12:49:56.525512479 (3h10m18.269569349s) [upload=3303]: Waiting for error group managing segments... Aug 7 12:49:56.525579289 (3h10m18.269636156s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:49:56.525585348 (3h10m18.269642216s) [upload=3303]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:49:56.525592129 (3h10m18.269649174s) [upload=3303]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:49:56.784225863 (3h10m18.528282718s) [upload=3303]: Done uploading segments... Aug 7 12:49:56.784250039 (3h10m18.528306889s) [upload=3303]: Upload finished. err: <nil> Aug 7 12:51:09.671779029 (3h11m31.4158359s) [upload=3324]: Starting upload Aug 7 12:51:09.671855331 (3h11m31.415912183s) [upload=3324]: Done starting upload Aug 7 12:51:09.671971173 (3h11m31.416028035s) [upload=3324]: Uploading segments... Aug 7 12:51:09.672041061 (3h11m31.416097952s) [upload=3324]: Got next segment. Inline: true Aug 7 12:51:09.672050199 (3h11m31.41610707s) [upload=3324]: Waiting for error group managing segments... Aug 7 12:51:09.672125745 (3h11m31.416182633s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:51:09.672132072 (3h11m31.416188942s) [upload=3324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:51:09.672135512 (3h11m31.416192395s) [upload=3324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:51:09.854359979 (3h11m31.598416852s) [upload=3324]: Done uploading segments... Aug 7 12:51:09.854396299 (3h11m31.598453161s) [upload=3324]: Upload finished. err: <nil> Aug 7 12:52:09.317140199 (3h12m31.061197061s) [upload=3343]: Starting upload Aug 7 12:52:09.317217287 (3h12m31.061274156s) [upload=3343]: Done starting upload Aug 7 12:52:09.317324484 (3h12m31.061381346s) [upload=3343]: Uploading segments... Aug 7 12:52:09.317387573 (3h12m31.061444444s) [upload=3343]: Got next segment. Inline: true Aug 7 12:52:09.317394373 (3h12m31.061451245s) [upload=3343]: Waiting for error group managing segments... Aug 7 12:52:09.317463065 (3h12m31.061519932s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:52:09.317469392 (3h12m31.061526255s) [upload=3343]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:52:09.317473540 (3h12m31.061530408s) [upload=3343]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:52:09.481121528 (3h12m31.2251784s) [upload=3343]: Done uploading segments... Aug 7 12:52:09.481147652 (3h12m31.225204519s) [upload=3343]: Upload finished. err: <nil> Aug 7 12:53:02.326507253 (3h13m24.070564122s) [upload=3357]: Starting upload Aug 7 12:53:02.327006975 (3h13m24.071063843s) [upload=3357]: Done starting upload Aug 7 12:53:02.327072694 (3h13m24.071129558s) [upload=3357]: Uploading segments... Aug 7 12:53:02.327309584 (3h13m24.071366462s) [upload=3357]: Got next segment. Inline: true Aug 7 12:53:02.327320381 (3h13m24.071377257s) [upload=3357]: Waiting for error group managing segments... Aug 7 12:53:02.327404917 (3h13m24.071461785s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:02.327412155 (3h13m24.07146902s) [upload=3357]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:02.327416649 (3h13m24.071473522s) [upload=3357]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:02.586308264 (3h13m24.330365132s) [upload=3357]: Done uploading segments... Aug 7 12:53:02.586334213 (3h13m24.330391081s) [upload=3357]: Upload finished. err: <nil> Aug 7 12:53:56.086329854 (3h14m17.830386709s) [upload=3375]: Starting upload Aug 7 12:53:56.086406572 (3h14m17.83046345s) [upload=3375]: Done starting upload Aug 7 12:53:56.086492179 (3h14m17.83054903s) [upload=3375]: Uploading segments... Aug 7 12:53:56.086548223 (3h14m17.830605092s) [upload=3375]: Got next segment. Inline: true Aug 7 12:53:56.086554443 (3h14m17.830611305s) [upload=3375]: Waiting for error group managing segments... Aug 7 12:53:56.086605834 (3h14m17.830662707s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:53:56.086611420 (3h14m17.830668286s) [upload=3375]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:53:56.086614788 (3h14m17.830671649s) [upload=3375]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:53:56.231130326 (3h14m17.975187186s) [upload=3375]: Done uploading segments... Aug 7 12:53:56.231150241 (3h14m17.975207092s) [upload=3375]: Upload finished. err: <nil> Aug 7 12:55:03.257318828 (3h15m25.001375694s) [upload=3390]: Starting upload Aug 7 12:55:03.257403717 (3h15m25.00146059s) [upload=3390]: Done starting upload Aug 7 12:55:03.257508689 (3h15m25.001565551s) [upload=3390]: Uploading segments... Aug 7 12:55:03.257591428 (3h15m25.001648305s) [upload=3390]: Got next segment. Inline: true Aug 7 12:55:03.257599631 (3h15m25.001656501s) [upload=3390]: Waiting for error group managing segments... Aug 7 12:55:03.257658410 (3h15m25.001715274s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:03.257665829 (3h15m25.001722699s) [upload=3390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:03.257671569 (3h15m25.001728442s) [upload=3390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:03.528213045 (3h15m25.27226994s) [upload=3390]: Done uploading segments... Aug 7 12:55:03.528253324 (3h15m25.272310188s) [upload=3390]: Upload finished. err: <nil> Aug 7 12:55:31.305546778 (3h15m53.049603641s) [upload=3400]: Starting upload Aug 7 12:55:31.305647978 (3h15m53.049704839s) [upload=3400]: Done starting upload Aug 7 12:55:31.305785945 (3h15m53.049842798s) [upload=3400]: Uploading segments... Aug 7 12:55:31.305864878 (3h15m53.049921744s) [upload=3400]: Got next segment. Inline: true Aug 7 12:55:31.305871650 (3h15m53.049928517s) [upload=3400]: Waiting for error group managing segments... Aug 7 12:55:31.305959760 (3h15m53.050016621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:55:31.305968205 (3h15m53.050025066s) [upload=3400]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:55:31.305971757 (3h15m53.050028621s) [upload=3400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:55:31.467120517 (3h15m53.211177378s) [upload=3400]: Done uploading segments... Aug 7 12:55:31.467145539 (3h15m53.211202387s) [upload=3400]: Upload finished. err: <nil> Duration: 1.00730852s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)