Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.485508283s FAIL (2025-08-08 03:05:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.485538132s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.............X...........................X............X...] duration: 840.868686ms FAIL (2025-08-08 03:04:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil> Duration: 840.897651ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.............X...........................X............X..] duration: 953.900254ms FAIL (2025-08-08 03:04:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil> Duration: 953.938207ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.40178848s FAIL (2025-08-08 03:04:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.401826583s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.............X...........................X............X.] duration: 948.238126ms FAIL (2025-08-08 03:03:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil> Duration: 948.268091ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.438873082s FAIL (2025-08-08 03:03:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.438908335s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X.............X...........................X............X] duration: 1.775317034s FAIL (2025-08-08 03:02:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil> Duration: 1.775348453s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.51092197s FAIL (2025-08-08 03:02:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.511043704s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X.............X...........................X............] duration: 902.129353ms FAIL (2025-08-08 03:01:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 902.156259ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.56205319s FAIL (2025-08-08 03:01:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.56208428s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X.............X...........................X...........] duration: 1.003519724s FAIL (2025-08-08 03:00:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 1.003546696s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.388881675s FAIL (2025-08-08 03:00:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.388912792s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X.............X...........................X..........] duration: 866.189643ms FAIL (2025-08-08 03:00:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 866.228771ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X.............X...........................X.........] duration: 969.796238ms FAIL (2025-08-08 03:00:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 969.830697ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.569812846s FAIL (2025-08-08 02:59:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.569859562s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.475436296s FAIL (2025-08-08 02:59:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.47546474s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X.............X...........................X........] duration: 837.599112ms FAIL (2025-08-08 02:58:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 837.63274ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.338631375s FAIL (2025-08-08 02:58:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.338737872s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X.............X...........................X.......] duration: 867.818249ms FAIL (2025-08-08 02:58:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 867.852199ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X.............X...........................X......] duration: 892.375967ms FAIL (2025-08-08 02:57:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 892.410854ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.776045349s FAIL (2025-08-08 02:57:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.776074741s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X.............X...........................X.....] duration: 1.276040936s FAIL (2025-08-08 02:57:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 1.276072843s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.280237523s FAIL (2025-08-08 02:56:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.280269819s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X.............X...........................X....] duration: 885.94764ms FAIL (2025-08-08 02:56:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 885.987604ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X.............X...........................X...] duration: 848.317093ms FAIL (2025-08-08 02:55:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 848.352177ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.352732926s FAIL (2025-08-08 02:55:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.352764908s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X.............X...........................X..] duration: 825.104371ms FAIL (2025-08-08 02:54:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 825.13414ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X.............X...........................X.] duration: 872.202743ms FAIL (2025-08-08 02:54:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 872.236029ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.37944959s FAIL (2025-08-08 02:54:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.379476839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X.............X...........................X] duration: 765.695429ms FAIL (2025-08-08 02:53:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 6dfc86b86c2d2c329d27e62886ec756af37ecc293d36767a37df53a699764383 != before e25f9c37fba9150a30c00567faee394332709597109fed1f299469688c25a788 ======LOGS====== 7h6m25.373008374s) [upload=17660]: Done uploading segments... Aug 8 02:46:03.628977494 (17h6m25.373034341s) [upload=17660]: Upload finished. err: <nil> Aug 8 02:46:35.556184988 (17h6m57.30024185s) [upload=17669]: Starting upload Aug 8 02:46:35.556264491 (17h6m57.300321362s) [upload=17669]: Done starting upload Aug 8 02:46:35.556379423 (17h6m57.300436285s) [upload=17669]: Uploading segments... Aug 8 02:46:35.556451155 (17h6m57.300508026s) [upload=17669]: Got next segment. Inline: true Aug 8 02:46:35.556458235 (17h6m57.3005151s) [upload=17669]: Waiting for error group managing segments... Aug 8 02:46:35.556537890 (17h6m57.300594754s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:35.556544709 (17h6m57.300601573s) [upload=17669]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:35.556548555 (17h6m57.300605416s) [upload=17669]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:35.696334570 (17h6m57.44039143s) [upload=17669]: Done uploading segments... Aug 8 02:46:35.696358594 (17h6m57.440415445s) [upload=17669]: Upload finished. err: <nil> Aug 8 02:47:16.614915405 (17h7m38.358972255s) [upload=17680]: Starting upload Aug 8 02:47:16.614995377 (17h7m38.359052251s) [upload=17680]: Done starting upload Aug 8 02:47:16.615150534 (17h7m38.359207381s) [upload=17680]: Uploading segments... Aug 8 02:47:16.615291642 (17h7m38.359348507s) [upload=17680]: Got next segment. Inline: true Aug 8 02:47:16.615298954 (17h7m38.359355815s) [upload=17680]: Waiting for error group managing segments... Aug 8 02:47:16.615358725 (17h7m38.359415576s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:16.615364788 (17h7m38.359421648s) [upload=17680]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:16.615368511 (17h7m38.359425372s) [upload=17680]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:16.824777512 (17h7m38.568834376s) [upload=17680]: Done uploading segments... Aug 8 02:47:16.824816543 (17h7m38.568873407s) [upload=17680]: Upload finished. err: <nil> Aug 8 02:48:23.797954397 (17h8m45.542011245s) [upload=17699]: Starting upload Aug 8 02:48:23.798071613 (17h8m45.542128463s) [upload=17699]: Done starting upload Aug 8 02:48:23.798154411 (17h8m45.542211261s) [upload=17699]: Uploading segments... Aug 8 02:48:23.798195717 (17h8m45.542252586s) [upload=17699]: Got next segment. Inline: true Aug 8 02:48:23.798201619 (17h8m45.542258479s) [upload=17699]: Waiting for error group managing segments... Aug 8 02:48:23.798285767 (17h8m45.542342616s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:23.798291812 (17h8m45.542348673s) [upload=17699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:23.798295272 (17h8m45.542352133s) [upload=17699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:24.215606073 (17h8m45.959662933s) [upload=17699]: Done uploading segments... Aug 8 02:48:24.215625829 (17h8m45.95968268s) [upload=17699]: Upload finished. err: <nil> Aug 8 02:48:54.559561975 (17h9m16.303618835s) [upload=17707]: Starting upload Aug 8 02:48:54.559628357 (17h9m16.303685207s) [upload=17707]: Done starting upload Aug 8 02:48:54.559773687 (17h9m16.303830536s) [upload=17707]: Uploading segments... Aug 8 02:48:54.559857137 (17h9m16.303914011s) [upload=17707]: Got next segment. Inline: true Aug 8 02:48:54.559867550 (17h9m16.303924417s) [upload=17707]: Waiting for error group managing segments... Aug 8 02:48:54.559955116 (17h9m16.304011981s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:54.559965920 (17h9m16.304022866s) [upload=17707]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:54.559971277 (17h9m16.304028141s) [upload=17707]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:54.991440340 (17h9m16.735497214s) [upload=17707]: Done uploading segments... Aug 8 02:48:54.991578038 (17h9m16.7356349s) [upload=17707]: Upload finished. err: <nil> Aug 8 02:50:04.240866547 (17h10m25.984923409s) [upload=17727]: Starting upload Aug 8 02:50:04.240917045 (17h10m25.984973906s) [upload=17727]: Done starting upload Aug 8 02:50:04.241007304 (17h10m25.985064165s) [upload=17727]: Uploading segments... Aug 8 02:50:04.241070015 (17h10m25.985126886s) [upload=17727]: Got next segment. Inline: true Aug 8 02:50:04.241075954 (17h10m25.985132815s) [upload=17727]: Waiting for error group managing segments... Aug 8 02:50:04.241123623 (17h10m25.985180484s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:04.241129064 (17h10m25.985185925s) [upload=17727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:04.241132588 (17h10m25.985189449s) [upload=17727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:04.398737632 (17h10m26.142794503s) [upload=17727]: Done uploading segments... Aug 8 02:50:04.398762328 (17h10m26.142819193s) [upload=17727]: Upload finished. err: <nil> Aug 8 02:50:21.788072533 (17h10m43.532129391s) [upload=17732]: Starting upload Aug 8 02:50:21.788155479 (17h10m43.532212329s) [upload=17732]: Done starting upload Aug 8 02:50:21.788265355 (17h10m43.532322208s) [upload=17732]: Uploading segments... Aug 8 02:50:21.788334673 (17h10m43.532391543s) [upload=17732]: Got next segment. Inline: true Aug 8 02:50:21.788341930 (17h10m43.532398793s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:50:21.788414924 (17h10m43.53247179s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:21.788423332 (17h10m43.532480195s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:21.788427841 (17h10m43.532484705s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:22.019627174 (17h10m43.763684021s) [upload=17732]: Done uploading segments... Aug 8 02:50:22.019648885 (17h10m43.763705732s) [upload=17732]: Upload finished. err: <nil> Aug 8 02:51:14.995569550 (17h11m36.73962642s) [upload=17746]: Starting upload Aug 8 02:51:14.995646952 (17h11m36.739703813s) [upload=17746]: Done starting upload Aug 8 02:51:14.995741334 (17h11m36.739798183s) [upload=17746]: Uploading segments... Aug 8 02:51:14.995861929 (17h11m36.7399188s) [upload=17746]: Got next segment. Inline: true Aug 8 02:51:14.995870000 (17h11m36.739926864s) [upload=17746]: Waiting for error group managing segments... Aug 8 02:51:14.995929761 (17h11m36.739986611s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:14.995935516 (17h11m36.739992376s) [upload=17746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:14.995939031 (17h11m36.739995891s) [upload=17746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:15.183941100 (17h11m36.927997954s) [upload=17746]: Done uploading segments... Aug 8 02:51:15.183960802 (17h11m36.928017652s) [upload=17746]: Upload finished. err: <nil> Aug 8 02:52:15.165071842 (17h12m36.909128693s) [upload=17766]: Starting upload Aug 8 02:52:15.165135377 (17h12m36.909192237s) [upload=17766]: Done starting upload Aug 8 02:52:15.165233002 (17h12m36.909289851s) [upload=17766]: Uploading segments... Aug 8 02:52:15.165293413 (17h12m36.909350282s) [upload=17766]: Got next segment. Inline: true Aug 8 02:52:15.165299271 (17h12m36.909356124s) [upload=17766]: Waiting for error group managing segments... Aug 8 02:52:15.165371255 (17h12m36.909428107s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:15.165379908 (17h12m36.909436769s) [upload=17766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:15.165383387 (17h12m36.909440237s) [upload=17766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:15.320969967 (17h12m37.065026821s) [upload=17766]: Done uploading segments... Aug 8 02:52:15.320988428 (17h12m37.065045278s) [upload=17766]: Upload finished. err: <nil> Aug 8 02:53:05.460152109 (17h13m27.204208964s) [upload=17779]: Starting upload Aug 8 02:53:05.460245574 (17h13m27.204302431s) [upload=17779]: Done starting upload Aug 8 02:53:05.460389879 (17h13m27.20444673s) [upload=17779]: Uploading segments... Aug 8 02:53:05.460522962 (17h13m27.204579823s) [upload=17779]: Got next segment. Inline: true Aug 8 02:53:05.460532690 (17h13m27.204589558s) [upload=17779]: Waiting for error group managing segments... Aug 8 02:53:05.460610912 (17h13m27.204667773s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:05.460616883 (17h13m27.204673746s) [upload=17779]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:05.460621822 (17h13m27.204678683s) [upload=17779]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:05.621986632 (17h13m27.366043484s) [upload=17779]: Done uploading segments... Aug 8 02:53:05.622006633 (17h13m27.366063483s) [upload=17779]: Upload finished. err: <nil> Aug 8 02:53:50.403249002 (17h14m12.147305862s) [upload=17794]: Starting upload Aug 8 02:53:50.403302767 (17h14m12.14735963s) [upload=17794]: Done starting upload Aug 8 02:53:50.403375953 (17h14m12.147432804s) [upload=17794]: Uploading segments... Aug 8 02:53:50.403529909 (17h14m12.147586772s) [upload=17794]: Got next segment. Inline: true Aug 8 02:53:50.403540193 (17h14m12.147597062s) [upload=17794]: Waiting for error group managing segments... Aug 8 02:53:50.403607641 (17h14m12.147664491s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:53:50.403613153 (17h14m12.147670016s) [upload=17794]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:53:50.403616586 (17h14m12.147673445s) [upload=17794]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:53:50.578224101 (17h14m12.322280953s) [upload=17794]: Done uploading segments... Aug 8 02:53:50.578241416 (17h14m12.322298266s) [upload=17794]: Upload finished. err: <nil> Duration: 765.723085ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.471621745s FAIL (2025-08-08 02:53:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.471653892s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X.............X...........................] duration: 836.927198ms FAIL (2025-08-08 02:53:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 836.972974ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.66667529s FAIL (2025-08-08 02:52:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.666715926s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X.............X..........................] duration: 881.247707ms FAIL (2025-08-08 02:52:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 881.288715ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.491262982s FAIL (2025-08-08 02:52:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.491315529s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.443714325s FAIL (2025-08-08 02:51:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.443756921s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X.............X.........................] duration: 909.637271ms FAIL (2025-08-08 02:51:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 909.670603ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.390415059s FAIL (2025-08-08 02:50:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.390456964s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.............X........................] duration: 1.046192374s FAIL (2025-08-08 02:50:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 1.046304592s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X.............X.......................] duration: 951.454921ms FAIL (2025-08-08 02:50:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 951.556614ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.632428358s FAIL (2025-08-08 02:49:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.632471161s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X.............X......................] duration: 1.369245325s FAIL (2025-08-08 02:48:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 1.369276999s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 3.081189662s FAIL (2025-08-08 02:48:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 3.081227775s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X.............X.....................] duration: 1.38168336s FAIL (2025-08-08 02:48:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 1.381720745s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.74510933s FAIL (2025-08-08 02:47:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.745153966s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.471379972s FAIL (2025-08-08 02:47:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.471411726s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.............X....................] duration: 949.771783ms FAIL (2025-08-08 02:47:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 949.795318ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.418946669s FAIL (2025-08-08 02:46:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece... Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments... Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil> Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces. Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments... Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil> Duration: 2.418980154s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.............X...................] duration: 809.45964ms FAIL (2025-08-08 02:46:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 809.488859ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X..........................X.............X..................] duration: 820.385756ms FAIL (2025-08-08 02:46:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== one uploading segments... Aug 8 02:23:10.414295123 (16h43m32.158351969s) [upload=17268]: Upload finished. err: <nil> Aug 8 02:24:10.077755702 (16h44m31.821812563s) [upload=17285]: Starting upload Aug 8 02:24:10.077853414 (16h44m31.821910267s) [upload=17285]: Done starting upload Aug 8 02:24:10.078072158 (16h44m31.82212902s) [upload=17285]: Uploading segments... Aug 8 02:24:10.078171612 (16h44m31.82222848s) [upload=17285]: Got next segment. Inline: true Aug 8 02:24:10.078181515 (16h44m31.822238391s) [upload=17285]: Waiting for error group managing segments... Aug 8 02:24:10.078267993 (16h44m31.822324869s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:10.078276548 (16h44m31.822333417s) [upload=17285]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:10.078281378 (16h44m31.82233824s) [upload=17285]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:10.230418532 (16h44m31.974475396s) [upload=17285]: Done uploading segments... Aug 8 02:24:10.230441517 (16h44m31.974498367s) [upload=17285]: Upload finished. err: <nil> Aug 8 02:24:34.415084156 (16h44m56.159141003s) [upload=17294]: Starting upload Aug 8 02:24:34.415145662 (16h44m56.159202525s) [upload=17294]: Done starting upload Aug 8 02:24:34.415294895 (16h44m56.159351741s) [upload=17294]: Uploading segments... Aug 8 02:24:34.415355869 (16h44m56.159412736s) [upload=17294]: Got next segment. Inline: true Aug 8 02:24:34.415361104 (16h44m56.159417964s) [upload=17294]: Waiting for error group managing segments... Aug 8 02:24:34.415411147 (16h44m56.159467993s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:24:34.415416228 (16h44m56.159473074s) [upload=17294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:24:34.415419283 (16h44m56.159476129s) [upload=17294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:24:34.749447838 (16h44m56.493504686s) [upload=17294]: Done uploading segments... Aug 8 02:24:34.749465752 (16h44m56.493522599s) [upload=17294]: Upload finished. err: <nil> Aug 8 02:25:32.246677604 (16h45m53.99073445s) [upload=17310]: Starting upload Aug 8 02:25:32.246725852 (16h45m53.990782713s) [upload=17310]: Done starting upload Aug 8 02:25:32.246783578 (16h45m53.990840424s) [upload=17310]: Uploading segments... Aug 8 02:25:32.246829038 (16h45m53.990885909s) [upload=17310]: Got next segment. Inline: true Aug 8 02:25:32.246833359 (16h45m53.990890221s) [upload=17310]: Waiting for error group managing segments... Aug 8 02:25:32.247149406 (16h45m53.991206253s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:25:32.247158622 (16h45m53.991215485s) [upload=17310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:25:32.247162211 (16h45m53.991219075s) [upload=17310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:25:32.399400871 (16h45m54.143457719s) [upload=17310]: Done uploading segments... Aug 8 02:25:32.399419997 (16h45m54.143476843s) [upload=17310]: Upload finished. err: <nil> Aug 8 02:26:39.976648002 (16h47m1.720704862s) [upload=17325]: Starting upload Aug 8 02:26:39.976698806 (16h47m1.720755669s) [upload=17325]: Done starting upload Aug 8 02:26:39.976790930 (16h47m1.720847777s) [upload=17325]: Uploading segments... Aug 8 02:26:39.976830687 (16h47m1.720887556s) [upload=17325]: Got next segment. Inline: true Aug 8 02:26:39.976835119 (16h47m1.720891965s) [upload=17325]: Waiting for error group managing segments... Aug 8 02:26:39.976884108 (16h47m1.720940954s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:26:39.976888631 (16h47m1.720945477s) [upload=17325]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:26:39.976892954 (16h47m1.720949817s) [upload=17325]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:26:40.164407867 (16h47m1.908464731s) [upload=17325]: Done uploading segments... Aug 8 02:26:40.164432508 (16h47m1.908489365s) [upload=17325]: Upload finished. err: <nil> Aug 8 02:27:07.423627185 (16h47m29.167684058s) [upload=17336]: Starting upload Aug 8 02:27:07.423690646 (16h47m29.167747517s) [upload=17336]: Done starting upload Aug 8 02:27:07.423767165 (16h47m29.167824013s) [upload=17336]: Uploading segments... Aug 8 02:27:07.423841574 (16h47m29.167898448s) [upload=17336]: Got next segment. Inline: true Aug 8 02:27:07.423849047 (16h47m29.167905914s) [upload=17336]: Waiting for error group managing segments... Aug 8 02:27:07.423913265 (16h47m29.167970131s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:27:07.423919811 (16h47m29.167976683s) [upload=17336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:27:07.423923976 (16h47m29.167980842s) [upload=17336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:27:07.729084705 (16h47m29.473141555s) [upload=17336]: Done uploading segments... Aug 8 02:27:07.729121553 (16h47m29.473178404s) [upload=17336]: Upload finished. err: <nil> Aug 8 02:28:18.393964304 (16h48m40.138021164s) [upload=17355]: Starting upload Aug 8 02:28:18.394025424 (16h48m40.138082271s) [upload=17355]: Done starting upload Aug 8 02:28:18.394098897 (16h48m40.138155759s) [upload=17355]: Uploading segments... Aug 8 02:28:18.394191323 (16h48m40.138248194s) [upload=17355]: Got next segment. Inline: true Aug 8 02:28:18.394233759 (16h48m40.13829063s) [upload=17355]: Waiting for error group managing segments... Aug 8 02:28:18.394303915 (16h48m40.138360785s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:18.394311036 (16h48m40.138367903s) [upload=17355]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:18.394315489 (16h48m40.138372357s) [upload=17355]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:18.538024219 (16h48m40.28208107s) [upload=17355]: Done uploading segments... Aug 8 02:28:18.538045021 (16h48m40.282101871s) [upload=17355]: Upload finished. err: <nil> Aug 8 02:28:52.934400909 (16h49m14.67845778s) [upload=17365]: Starting upload Aug 8 02:28:52.934499889 (16h49m14.678556755s) [upload=17365]: Done starting upload Aug 8 02:28:52.934599332 (16h49m14.678656188s) [upload=17365]: Uploading segments... Aug 8 02:28:52.934700838 (16h49m14.678757702s) [upload=17365]: Got next segment. Inline: true Aug 8 02:28:52.934708711 (16h49m14.678765573s) [upload=17365]: Waiting for error group managing segments... Aug 8 02:28:52.934779207 (16h49m14.678836071s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:28:52.934786979 (16h49m14.678843829s) [upload=17365]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:28:52.934804891 (16h49m14.678861752s) [upload=17365]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:28:53.119203969 (16h49m14.863260821s) [upload=17365]: Done uploading segments... Aug 8 02:28:53.119309879 (16h49m14.863366735s) [upload=17365]: Upload finished. err: <nil> Aug 8 02:29:44.744620254 (16h50m6.488677105s) [upload=17379]: Starting upload Aug 8 02:29:44.744685590 (16h50m6.48874245s) [upload=17379]: Done starting upload Aug 8 02:29:44.744779992 (16h50m6.488836843s) [upload=17379]: Uploading segments... Aug 8 02:29:44.744858993 (16h50m6.48891586s) [upload=17379]: Got next segment. Inline: true Aug 8 02:29:44.744865876 (16h50m6.488922737s) [upload=17379]: Waiting for error group managing segments... Aug 8 02:29:44.744923290 (16h50m6.488980325s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:29:44.744930648 (16h50m6.48898751s) [upload=17379]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:29:44.744935245 (16h50m6.488992106s) [upload=17379]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:29:45.126988388 (16h50m6.871045254s) [upload=17379]: Done uploading segments... Aug 8 02:29:45.127025878 (16h50m6.871082746s) [upload=17379]: Upload finished. err: <nil> Aug 8 02:30:42.856740633 (16h51m4.600797483s) [upload=17399]: Starting upload Aug 8 02:30:42.856818047 (16h51m4.600874912s) [upload=17399]: Done starting upload Aug 8 02:30:42.856891264 (16h51m4.600948114s) [upload=17399]: Uploading segments... Aug 8 02:30:42.856939152 (16h51m4.600996023s) [upload=17399]: Got next segment. Inline: true Aug 8 02:30:42.856945819 (16h51m4.601002683s) [upload=17399]: Waiting for error group managing segments... Aug 8 02:30:42.856995123 (16h51m4.601051987s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:30:42.857001749 (16h51m4.60105861s) [upload=17399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:30:42.857006712 (16h51m4.601063577s) [upload=17399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:30:43.013775175 (16h51m4.757832045s) [upload=17399]: Done uploading segments... Aug 8 02:30:43.013800101 (16h51m4.757856962s) [upload=17399]: Upload finished. err: <nil> Aug 8 02:31:18.582930120 (16h51m40.326986988s) [upload=17410]: Starting upload Aug 8 02:31:18.583008407 (16h51m40.327065279s) [upload=17410]: Done starting upload Aug 8 02:31:18.583123226 (16h51m40.32718008s) [upload=17410]: Uploading segments... Aug 8 02:31:18.583183577 (16h51m40.327240437s) [upload=17410]: Got next segment. Inline: true Aug 8 02:31:18.583189108 (16h51m40.327245969s) [upload=17410]: Waiting for error group managing segments... Aug 8 02:31:18.583343098 (16h51m40.327399967s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:31:18.583354634 (16h51m40.327411482s) [upload=17410]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:31:18.583359712 (16h51m40.327416578s) [upload=17410]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:31:18.670809331 (16h51m40.414866194s) [upload=17410]: Done uploading segments... Aug 8 02:31:18.670828587 (16h51m40.414885435s) [upload=17410]: Upload finished. err: metaclient: Too Many Requests Duration: 820.421083ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)