Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X...............X...........X.....................X.........] duration: 2.742277534s FAIL (2025-08-11 22:17:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 2.742310048s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [........XXX.................................................] duration: 420.98179ms FAIL (2025-08-11 22:17:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 421.019578ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.........XXX................................................] duration: 866.363556ms FAIL (2025-08-11 22:17:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 866.426051ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X...............X...........X.....................X........] duration: 3.111081s FAIL (2025-08-11 22:16:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 3.111115543s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..........XXX...............................................] duration: 432.509696ms FAIL (2025-08-11 22:16:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 432.541182ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...........XXX..............................................] duration: 472.559223ms FAIL (2025-08-11 22:16:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 472.582058ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X...............X...........X.....................X.......] duration: 2.85132718s FAIL (2025-08-11 22:15:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 2.851372202s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [............XXX.............................................] duration: 464.249324ms FAIL (2025-08-11 22:14:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 464.300478ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X...............X...........X.....................X......] duration: 2.569144134s FAIL (2025-08-11 22:14:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 2.569238883s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.............XXX............................................] duration: 427.425012ms FAIL (2025-08-11 22:13:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 427.482594ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X...............X...........X.....................X.....] duration: 3.03287378s FAIL (2025-08-11 22:13:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 3.032901684s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..............XXX...........................................] duration: 541.614476ms FAIL (2025-08-11 22:13:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 541.639862ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X...............X...........X.....................X....] duration: 3.213136263s FAIL (2025-08-11 22:12:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 3.213165779s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...............XXX..........................................] duration: 553.746ms FAIL (2025-08-11 22:11:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 553.831627ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X...............X...........X.....................X...] duration: 2.445207962s FAIL (2025-08-11 22:11:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 2.445244234s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [................XXX.........................................] duration: 820.880723ms FAIL (2025-08-11 22:11:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 820.977951ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.................XXX........................................] duration: 748.365346ms FAIL (2025-08-11 22:11:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 748.413232ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X...............X...........X.....................X..] duration: 2.539510334s FAIL (2025-08-11 22:10:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 2.539540756s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X...............X...........X.....................X.] duration: 2.867963536s FAIL (2025-08-11 22:10:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 2.867991643s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..................XXX.......................................] duration: 803.957792ms FAIL (2025-08-11 22:09:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 804.000397ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...................XXX......................................] duration: 382.3383ms FAIL (2025-08-11 22:09:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 382.379787ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X...............X...........X.....................X] duration: 1.823195429s FAIL (2025-08-11 22:09:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:09:29.834617498 (76h43m51.793714782s) [upload=79990]: Starting upload Aug 11 22:09:29.834689496 (76h43m51.79378675s) [upload=79990]: Done starting upload Aug 11 22:09:29.834792831 (76h43m51.793890081s) [upload=79990]: Uploading segments... Aug 11 22:09:29.835072426 (76h43m51.794169699s) [upload=79990]: Got next segment. Inline: false Aug 11 22:09:29.835166195 (76h43m51.79426345s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:09:29.835173793 (76h43m51.794271042s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:09:30.045774981 (76h43m52.004872248s) [seg_pos={0 0}, upload=79990]: Begin upload segment... Aug 11 22:09:30.045903603 (76h43m52.005000849s) [seg_pos={0 0}, upload=79990]: Done begin upload segment. Aug 11 22:09:30.045941514 (76h43m52.00503876s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.045970702 (76h43m52.005067954s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046559781 (76h43m52.005657027s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.046618630 (76h43m52.005715885s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047115565 (76h43m52.006212816s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047126849 (76h43m52.006224104s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.047718376 (76h43m52.006815628s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048213450 (76h43m52.007310698s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.048826916 (76h43m52.007924161s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049257446 (76h43m52.008354695s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.049628311 (76h43m52.008725566s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050200587 (76h43m52.009297843s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.050832344 (76h43m52.009929601s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051369050 (76h43m52.010466295s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.051841343 (76h43m52.010938598s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052328003 (76h43m52.011425256s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.052805403 (76h43m52.011902655s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.053239849 (76h43m52.012337224s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Uploading piece... Aug 11 22:09:30.613216175 (76h43m52.572313407s) [upload=79990]: Next returned nil segment Aug 11 22:09:30.613226095 (76h43m52.57232334s) [upload=79990]: Waiting for error group managing segments... Aug 11 22:09:30.760405071 (76h43m52.719502316s) [noise=true , address=45.91.116.11:4151 , piece_id=65HMWTDD5CJQ4UJQWB2ARZQNEG3WTCS3TOMVKCTQLYLXJQNHW6HA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.771828859 (76h43m52.730926114s) [noise=true , address=104.36.82.39:4743 , piece_id=RWGPUHSRGR7ZJDK7Y5INQXEG7OTNXK2ATIMATBHVPD5YL7SZ4FXA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.802254717 (76h43m52.761351963s) [noise=true , address=104.36.82.8:4001 , piece_id=HJP57DDBFC23KPMWNBN5PGERACRABMITAFEYM5POXCS2Z2ZJPNFA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.804482196 (76h43m52.763579437s) [noise=true , address=104.36.82.12:4169 , piece_id=LL35HRMZSHWWUVL7VOX3YZTQBKZR5KIT23L3LDOFZQEWETNW7KPQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.810532414 (76h43m52.76962966s) [noise=true , address=104.36.82.4:4836 , piece_id=6K7LTDB6CRDVV75KOUIRFY7OU6MLA4R3JJIBGEM6X74PYCPB3M4A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.814461441 (76h43m52.773558679s) [noise=true , address=104.36.82.37:4659 , piece_id=YVHKP3DPSQJFZUTDLDKZFTI3T43A2C6B7W3JRN55MJNQWBUFBUVA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.818873117 (76h43m52.777970349s) [noise=true , address=104.36.82.35:4615 , piece_id=LPHPYXKPUUMYWM5HDO2T4WZGIC23CA7MN4UJP7R47E6AOZQE4CWA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.820873017 (76h43m52.779970263s) [noise=true , address=104.36.82.15:4278 , piece_id=FS44LTDPYN2ERC463ZMC2HZMBZLYE6UYFQCMEMVW5JOLIEEHLIOA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.833842657 (76h43m52.792939888s) [noise=true , address=104.36.82.18:4369 , piece_id=U5IZHVRON5YLISKFT7ZJ3G5X272HR4OMOVGKWEWJJP5ZAOLMFX7A, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.863495932 (76h43m52.822593176s) [noise=true , address=104.36.82.46:4496 , piece_id=PZDARIE4KFIGLTJ3DYUF2LHREEHOJIZQR2VM5KXY2QWDTPERUXOQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.873866143 (76h43m52.832963385s) [noise=true , address=104.36.82.59:4308 , piece_id=4SYDJ6Z5Z74CHTVPSGGPJWYL5LYME32YWVV2OKKJEMHNUXZBSBWQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.890909925 (76h43m52.850007174s) [noise=true , address=104.36.82.36:4621 , piece_id=TBDORRC3LIPC743NOMXFCBQIMOW25C4GZNBMHOOQKEVVU644SYBQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.895942963 (76h43m52.855040203s) [noise=true , address=104.36.82.38:4693 , piece_id=6BWU4FCRIRXHE5DJABZYSNPX7CEXDZT2LCKRI6WRTKCMGPE6TW4Q, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905667459 (76h43m52.864764708s) [noise=true , address=77.90.31.21:4896 , piece_id=7WUM4LOBHH7CVT3MP3HQDCTZUHGWYFYRLQJDK3AKQWYLQDSOKDUQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: <nil> Aug 11 22:09:30.905693606 (76h43m52.864790859s) [seg_pos={0 0}, upload=79990]: Segment reached optimal threshold of 14 pieces. Aug 11 22:09:30.905834176 (76h43m52.864931426s) [noise=true , address=77.90.31.13:4654 , piece_id=2P3YAXBZYLB5DF2UOOVBV4RGED54E23CGDDSDXMGCA6F4TEROXLA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1227esgYd6VByyMSV6ZBcvYqx6PahMt7SUgvYzYmiWJavNXGza8): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906100683 (76h43m52.865197949s) [noise=true , address=79.127.220.101:4051 , piece_id=6HIVXILT3E7VV524JZMQXWV2IK3QWMFLKMP2J5CTIMUZ6CVYNDCQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1k4AcRbE2d5beWuHg7qHMt4eekEo6XNqNtGUdJX6TaNCdKb4bB): protocol: expected piece hash; context canceled; EOF Aug 11 22:09:30.906311274 (76h43m52.865408529s) [noise=true , address=104.36.82.19:4420 , piece_id=M4GSHEPVT2RKNO6KSCQAKV3OWWXHM3YLMCE6NFHLJR33JTM6X3LQ, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hJrjeMUMYmFw3yxRtQQKRh9ciPfdu5FXo8NGrsc6HBqgfJzzp): protocol: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57704->104.36.82.19:4420: use of closed network connection Aug 11 22:09:30.906399665 (76h43m52.865496932s) [noise=true , address=104.36.82.5:4842 , piece_id=H4AY26U5RLBTEOC2I4S7RQO55OZXTN3TJJIVSZMRA7ELKLDE2DQA, seg_pos={0 0}, upload=79990]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12q4VdT5BcjUb16PBYHK6zrnW8dqENKrcGx9zdLtNefDVB1MUSn): protocol: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34188->104.36.82.5:4842: use of closed network connection Aug 11 22:09:30.906415825 (76h43m52.865513075s) [seg_pos={0 0}, upload=79990]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:09:30.906499280 (76h43m52.86559652s) [upload=79990]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:09:30.906505967 (76h43m52.865603222s) [upload=79990]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:09:31.090018110 (76h43m53.049115373s) [upload=79990]: Done uploading segments... Aug 11 22:09:31.090063198 (76h43m53.049160431s) [upload=79990]: Upload finished. err: <nil> Duration: 1.823231167s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.........X...............X...........X.....................] duration: 2.912922589s FAIL (2025-08-11 22:09:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.912956474s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.........X...............X...........X....................] duration: 2.64048616s FAIL (2025-08-11 22:08:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.640516735s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [....................XXX.....................................] duration: 1.69095899s FAIL (2025-08-11 22:08:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.690992457s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.....................XXX....................................] duration: 1.594791404s FAIL (2025-08-11 22:07:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.594843174s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.........X...............X...........X...................] duration: 2.560051777s FAIL (2025-08-11 22:07:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.56008708s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [......................XXX...................................] duration: 1.795112754s FAIL (2025-08-11 22:07:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.795222269s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.........X...............X...........X..................] duration: 2.875168966s FAIL (2025-08-11 22:07:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.875201019s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.......................XXX..................................] duration: 489.817522ms FAIL (2025-08-11 22:06:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 489.853735ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.........X...............X...........X.................] duration: 2.892893754s FAIL (2025-08-11 22:05:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.892989039s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [........................XXX.................................] duration: 1.827852995s FAIL (2025-08-11 22:05:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.827887955s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.........X...............X...........X................] duration: 3.263896934s FAIL (2025-08-11 22:04:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 3.263925723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.........................XXX................................] duration: 1.996256023s FAIL (2025-08-11 22:04:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.996292449s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.........X...............X...........X...............] duration: 2.741910707s FAIL (2025-08-11 22:04:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.741940802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..........................XXX...............................] duration: 1.880030918s FAIL (2025-08-11 22:03:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.880181842s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.........X...............X...........X..............] duration: 3.023472801s FAIL (2025-08-11 22:03:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 3.0234998s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...........................XXX..............................] duration: 524.801323ms FAIL (2025-08-11 22:02:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 524.838865ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X.........X...............X...........X.............] duration: 2.684666208s FAIL (2025-08-11 22:02:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.684698109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [............................XXX.............................] duration: 1.158126232s FAIL (2025-08-11 22:02:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.158160558s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X.........X...............X...........X............] duration: 2.633743046s FAIL (2025-08-11 22:01:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.63377064s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.........X...............X...........X...........] duration: 2.757324265s FAIL (2025-08-11 22:01:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.757376389s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.............................XXX............................] duration: 1.64981411s FAIL (2025-08-11 22:01:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 1.649853015s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.........X...............X...........X..........] duration: 2.681003706s FAIL (2025-08-11 22:00:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.681041297s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..............................XXX...........................] duration: 5.626224935s FAIL (2025-08-11 22:00:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 5.626273748s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.........X...............X...........X.........] duration: 2.879698239s FAIL (2025-08-11 21:59:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.879726681s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.........X...............X...........X........] duration: 2.806268517s FAIL (2025-08-11 21:59:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.806296693s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...............................XXX..........................] duration: 461.00383ms FAIL (2025-08-11 21:59:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 461.030869ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.........X...............X...........X.......] duration: 2.646352324s FAIL (2025-08-11 21:58:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 21:54:01.234852081 (76h28m23.193949341s) [upload=79721]: Starting upload Aug 11 21:54:01.234930221 (76h28m23.194027487s) [upload=79721]: Done starting upload Aug 11 21:54:01.235253478 (76h28m23.194350726s) [upload=79721]: Uploading segments... Aug 11 21:54:01.235375450 (76h28m23.194472705s) [upload=79721]: Got next segment. Inline: false Aug 11 21:54:01.235444098 (76h28m23.19454135s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 21:54:01.235451185 (76h28m23.194548425s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 21:54:01.441395491 (76h28m23.400492771s) [seg_pos={0 0}, upload=79721]: Begin upload segment... Aug 11 21:54:01.441467088 (76h28m23.400564337s) [seg_pos={0 0}, upload=79721]: Done begin upload segment. Aug 11 21:54:01.441505082 (76h28m23.400602336s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441521704 (76h28m23.40061896s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.441639547 (76h28m23.4007368s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442132798 (76h28m23.401230057s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442175796 (76h28m23.401273049s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442555959 (76h28m23.401653215s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.442664733 (76h28m23.401761988s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443004162 (76h28m23.402101419s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443177996 (76h28m23.402275255s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443415663 (76h28m23.402512914s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.443807796 (76h28m23.402905057s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444015865 (76h28m23.403113119s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444409995 (76h28m23.403507257s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444441587 (76h28m23.403538843s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444885002 (76h28m23.403982261s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.444905020 (76h28m23.404002279s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445334964 (76h28m23.404432197s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:01.445408898 (76h28m23.404506153s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Uploading piece... Aug 11 21:54:02.034967579 (76h28m23.994064838s) [upload=79721]: Next returned nil segment Aug 11 21:54:02.034992943 (76h28m23.994090202s) [upload=79721]: Waiting for error group managing segments... Aug 11 21:54:02.209416862 (76h28m24.168514121s) [noise=true , address=104.36.82.37:4681 , piece_id=Z5XENGR6GILWN4UZNKUZS6MPHEFN7L4M5UL24OL45KZHXCXSDGFQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.210260243 (76h28m24.169357504s) [noise=true , address=104.36.82.58:4272 , piece_id=LDITA3UHTWBPJ6UDGNNQFYI7BIFKF7Q6CN223477HRHVO3DL3C5Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.231522717 (76h28m24.190619973s) [noise=true , address=104.36.82.19:4415 , piece_id=GBC3ZHZZDYKNCGNCO3FTZ4G5IQQDTE33K3O52WTIOLZHIXMUOBRQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.235173584 (76h28m24.194270834s) [noise=true , address=104.36.82.23:4463 , piece_id=AXTJC2J2RTXA23ZLJPIXI3GSKMCN4NZJ2BPLEELY6377POVBMBHA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.254557988 (76h28m24.213655238s) [noise=true , address=79.127.219.38:4001 , piece_id=LFHQ5HAJECJBZOQOUZEA2OUHWEKYYNXWLZ6QGOTU5KPFKDO4YWUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.262318927 (76h28m24.221416168s) [noise=true , address=104.36.82.15:4263 , piece_id=LLLNBFVA5QLB3WAPBCRTMN5OJP2XVVFTNIHEF3DG4O2FUZTNHDJA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.263899826 (76h28m24.222997075s) [noise=true , address=104.36.82.21:4498 , piece_id=JGYX4CUGW5QHMU5IS3N337ZP7QSGCKOZBYN5JQYQ22ZHSJ3D7AUQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.275982498 (76h28m24.235079739s) [noise=true , address=104.36.82.15:4277 , piece_id=LAYK37RHKEOQWU2QCAUICTLI2EJTFGCX7KXL4E7LWAMT7XUF4NFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.281527540 (76h28m24.240624791s) [noise=true , address=104.36.82.35:4583 , piece_id=OQ2ST6QR3NQ7GMCQKRGM6V6NAFXUXH3K7K7VURMRVBPMMDOPEG4Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.283957954 (76h28m24.243055212s) [noise=true , address=104.36.82.16:4305 , piece_id=PHQWGMQN7HCCOYI5XRLIIIZ2KUKQ45H6XSJEVL5LPFXAX4NPNWVA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.292448867 (76h28m24.251546124s) [noise=true , address=104.36.82.9:4019 , piece_id=EMTTW6KYPKCYVPPL7AUTNZOSXRPK7S362OAWRARMXUREWNTK6VEQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.299004582 (76h28m24.258101837s) [noise=true , address=79.127.219.48:4086 , piece_id=JMHKHXCCNPOITCSDBDFNFOCONO4VKHB7BUXTT3LIVHE4362FYVYA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.342075148 (76h28m24.301172403s) [noise=true , address=104.36.82.16:4307 , piece_id=URU4SGWQSEMDTYTFOOVWX2NPZTDF6VZNAPRBP3JIQEL7L46SOBFA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402369958 (76h28m24.361467199s) [noise=true , address=104.36.82.11:4137 , piece_id=U4JFH2WOGZ3DPYCZVLPR2M4D242VJ5NI33KJ6TFSNKDSBQOZU5ZA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: <nil> Aug 11 21:54:02.402435765 (76h28m24.361533013s) [seg_pos={0 0}, upload=79721]: Segment reached optimal threshold of 14 pieces. Aug 11 21:54:02.402939390 (76h28m24.362036646s) [noise=true , address=64.49.13.138:4484 , piece_id=HGESUIVWP6DRK7KRLPAN74FJBBSWNS4F7KMTALLYHUP5LZ4EHTTA, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eJA68UbWuVhgmDLo4kHe3awpGfziwMRrbajaBEGNLua5VTZNQ): protocol: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40614->64.49.13.138:4484: use of closed network connection Aug 11 21:54:02.403119103 (76h28m24.36221636s) [noise=true , address=156.146.43.225:4441 , piece_id=FVZE3CYMBSJ5C6AVYTTMS3O4TA73WHPWTK3KWEIAUWNQP5IVW3JQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2fbu6KYkVaLhiGXS8RBnExWrprgf5j6eaSHu4iYbdm8rAKfY): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403378236 (76h28m24.362475485s) [noise=true , address=79.127.201.215:4344 , piece_id=732VK4X77325F7ARFUFPMF2YC3NB6A4DJIQ3YWIE53KRNVQXKYQQ, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403480004 (76h28m24.362577255s) [noise=true , address=104.36.82.2:4760 , piece_id=D6Q4U4C3Z2L3YIVAABHKVCCPOOIZQJO2BQBXQ3SHEXEQDHVUSC2Q, seg_pos={0 0}, upload=79721]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pgY3KuDopCrLXxvbVeNowHD9qSh2Gz7qcgUR1GpsxFkuoHhzB): protocol: expected piece hash; context canceled; EOF Aug 11 21:54:02.403496453 (76h28m24.362593709s) [seg_pos={0 0}, upload=79721]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 21:54:02.403664331 (76h28m24.362761581s) [upload=79721]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 21:54:02.403671940 (76h28m24.362769197s) [upload=79721]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 21:54:02.575608710 (76h28m24.534705966s) [upload=79721]: Done uploading segments... Aug 11 21:54:02.575636492 (76h28m24.534733732s) [upload=79721]: Upload finished. err: <nil> Duration: 2.646385311s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [................................XXX.........................] duration: 390.06141ms FAIL (2025-08-11 21:58:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 20) ======LOGS====== , upload=79498]: Uploading piece... Aug 11 21:41:28.492965827 (76h15m50.452063074s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.493304523 (76h15m50.45240177s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.494260922 (76h15m50.453358182s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495332470 (76h15m50.45442973s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.495970910 (76h15m50.45506818s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.496444509 (76h15m50.455541767s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Uploading piece... Aug 11 21:41:28.620030725 (76h15m50.579127958s) [upload=79498]: Next returned nil segment Aug 11 21:41:28.620048735 (76h15m50.579145981s) [upload=79498]: Waiting for error group managing segments... Aug 11 21:41:28.629298196 (76h15m50.588395448s) [noise=true , address=89.149.201.147:4016 , piece_id=27TYWWB7DUSTCEBKY46KCGXZUDBQMVTZIRJF37ZEYX4SEHZEUB2A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630214646 (76h15m50.589311906s) [noise=true , address=81.171.14.70:4039 , piece_id=I4GSRTDSX7CBBNDB63PMXGKIXS5IDPFTVMMJP7BL5ML6J3O52XCQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.630974374 (76h15m50.590071607s) [noise=true , address=89.149.201.147:4005 , piece_id=POJTEBZVVTNOMYD62QKE5CA2JPMM2BTDFMXAE6MK7KDLPFLWJKDQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.631729297 (76h15m50.59082653s) [noise=true , address=81.171.14.70:4031 , piece_id=B5RDSPMGIN6EDC7JZ5MOQ6F7XTN4BDD63PJ6Y4BPCKNLA6ZONLJQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.632392232 (76h15m50.591489483s) [noise=true , address=89.149.201.147:4003 , piece_id=LTAMY6LJ34WAXJ5IZAQ2VAXEAZGYHCRWKKRXP4PN4PKEPQBFMZ6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633009190 (76h15m50.592106448s) [noise=true , address=89.149.201.147:4009 , piece_id=CGCMKBQH7CQUJKPBGGWJB33LZVZYQJPIUIRJBO44P2EVSLFZPQTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.633532114 (76h15m50.592629361s) [noise=true , address=89.149.201.147:4021 , piece_id=3LUHG7ADYE2OQRBET3GCP2DEKRNUT2RDYRNQV3FAQWRF6U3NRNVA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634209732 (76h15m50.593306975s) [noise=true , address=89.149.201.147:4004 , piece_id=YKYH4GLKA3TO7E6AZPDTYTWL7K7A6THQGPEDY2UXIH5MMOIAUUQQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634562268 (76h15m50.593659511s) [noise=true , address=89.149.201.147:4024 , piece_id=DMQWOG3ZOAIATO37THYSHC3YY5EODTQOBSOBOWNTOAEOJSYBDC5Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.634797625 (76h15m50.593894863s) [noise=true , address=81.171.14.70:4036 , piece_id=MUE2QGEW4QHHYZZQPDJ253IWRVVZNKDICGTO657R72DD2CRS3DTA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635103025 (76h15m50.594200265s) [noise=true , address=89.149.201.147:4020 , piece_id=OZ4U5DM5GPSGBKHADXRNNWPCVB37SCGAXS4VR2OQ4ZS7CXLVDI2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.635505276 (76h15m50.594602525s) [noise=true , address=89.149.201.147:4007 , piece_id=KWNJ5GF7SVCHEBMMNSYKG5UJCKGA4UTWV4OPGG6QBU4ALHY5FVFQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637184868 (76h15m50.596282123s) [noise=true , address=81.171.14.70:4038 , piece_id=WIO3LVAALYRXXYWQ4BIXOJCWK75VBB2BPBOVOEJVFT5BMMVSZN7Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.637789402 (76h15m50.596886659s) [noise=true , address=81.171.14.70:4047 , piece_id=5T62LWBAD3P6IPNENO5AQOT7YWJDA3MOFIKGKCX5FSU7FVBIF7ZA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.638445296 (76h15m50.59754255s) [noise=true , address=81.171.14.70:4042 , piece_id=657AR4BS4S4AB2A6V7IE2ERHNPSMIHEIY4IJPDQNX2YIBKHIWAIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.639922774 (76h15m50.59902003s) [noise=true , address=89.149.201.147:4012 , piece_id=FDMOUVSQRDLPEC2H7B2IGH7QQNBCERWINCOXYBC77SIOW5WRMQOQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.644334896 (76h15m50.603432139s) [noise=true , address=89.149.201.147:4018 , piece_id=ANO54TXCLWSKCTKB52PH4KFLLCOSXI6VJMPPO64OED7IJKXXMNCA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.646142616 (76h15m50.605239859s) [noise=true , address=89.149.201.147:4023 , piece_id=NTHLH3WC36UIIA2UWY7IHVBIMBAQKHCFI7HNFBQ4LO2TQ5OCDQBQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.649535498 (76h15m50.608632744s) [noise=true , address=89.149.201.147:4014 , piece_id=6EF7PHIL7PH4XFRTZ2HHUSP4JHT3WTW2KKW45BKDZLRVC6MXSTTQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:41:28.655767760 (76h15m50.614864995s) [noise=true , address=81.171.14.70:4029 , piece_id=J5DMN5H5JJ47YWXUJL6E6YD4MSRCX3K65CNZLSUJIN4H37PCYAFA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: <nil> Aug 11 21:42:28.434334827 (76h16m50.393432061s) [noise=true , address=185.167.204.206:4069 , piece_id=FY2X22DHFMNEEROLEHPJSKGIEHNO7SDKABXC3X5KMNIOWWKOLD6A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Uan1TT5oAM3axhaviVFbvh83gThiZvwHMwbCD31ZZens6BQ4U, address:185.167.204.206:4069): protocol: write tcp 139.59.144.22:53548->185.167.204.206:4069: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434426322 (76h16m50.393523561s) [noise=true , address=185.167.204.205:4016 , piece_id=X3YYYHEBGMKNRDIXBDJIKFVNJTL5AZ7RCDBJ3OIRRTGY5J4KR47A, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: rpc: dial tcp 185.167.204.205:4016: i/o timeout; context deadline exceeded Aug 11 21:42:28.434525151 (76h16m50.393622401s) [noise=true , address=185.167.204.206:4038 , piece_id=M733YR3IEHWWKXMSPAFW7S5IHACALTA34TUA4HOARAPB4SV6DB2Q, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: write tcp 139.59.144.22:59314->185.167.204.206:4038: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434585233 (76h16m50.393682483s) [noise=true , address=185.167.204.206:4072 , piece_id=7TYCEZEVBNDDHBQCANKP3EFVJDTMKL3AS6LFEQMFJP2OST4J3SOA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: write tcp 139.59.144.22:57258->185.167.204.206:4072: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434738889 (76h16m50.393836141s) [noise=true , address=185.167.204.206:4057 , piece_id=EJTXN3KLFTQFZKTKI7MWSIWB6SJUGLG3NIQNZJFRDJ7GAIU32PIA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: rpc: dial tcp 185.167.204.206:4057: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434784220 (76h16m50.393881471s) [noise=true , address=185.167.204.205:4024 , piece_id=QEL34FCC7WNOFKELG6TYRQS7BGQ4JDNCYIHXPVQQK7R7JIMTUSXA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:38718->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434806832 (76h16m50.393904078s) [noise=true , address=185.167.204.205:4012 , piece_id=HH6IMUQRFO6A4CRYYUTBMA6JSJ5DNRDXYAMLZ7SIOPMZRWXB56LQ, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1V4S6bUds1LgcrVccy5NkBJMAG3QaGFJqhsYtVboesSdH2PUFh, address:185.167.204.205:4012): protocol: write tcp 139.59.144.22:37662->185.167.204.205:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434839249 (76h16m50.393936494s) [noise=true , address=185.167.204.206:4061 , piece_id=JDGGWXLAWYTCACJQKPY6WH64K7NAOQJZ6VUP2ZNBKPFJNPHPD6XA, seg_pos={0 0}, upload=79498]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: write tcp 139.59.144.22:56270->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:42:28.434886690 (76h16m50.393983946s) [seg_pos={0 0}, upload=79498]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil> Aug 11 21:42:28.464204638 (76h16m50.423301879s) [upload=79498]: Done uploading segments... Aug 11 21:42:28.464242167 (76h16m50.423339426s) [upload=79498]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20) Duration: 390.09656ms core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)